-- Logs begin at Mon 2022-08-29 23:35:46 UTC, end at Tue 2022-08-30 00:33:04 UTC. -- Aug 30 00:01:06.221756 dv-cinder-815746-8-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 30 00:01:06.232221 dv-cinder-815746-8-smb devstack@keystone.service[81648]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 00:01:06 2022] *** Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: nodename: dv-cinder-815746-8-smb Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: machine: x86_64 Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: clock source: unix Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: pcre jit disabled Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: detected number of CPU cores: 4 Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: current working directory: / Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: detected binary path: /usr/bin/uwsgi-core Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: your processes number limit is 47680 Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: your memory page size is 4096 bytes Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: detected max file descriptor number: 2048 Aug 30 00:01:06.232736 dv-cinder-815746-8-smb devstack@keystone.service[81648]: lock engine: pthread robust mutexes Aug 30 00:01:06.233556 dv-cinder-815746-8-smb devstack@keystone.service[81648]: thunder lock: enabled Aug 30 00:01:06.233556 dv-cinder-815746-8-smb devstack@keystone.service[81648]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 30 00:01:06.233556 dv-cinder-815746-8-smb devstack@keystone.service[81648]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 00:01:06.272796 dv-cinder-815746-8-smb devstack@keystone.service[81648]: Python main interpreter initialized at 0x5636606bb9c0 Aug 30 00:01:06.272796 dv-cinder-815746-8-smb devstack@keystone.service[81648]: python threads support enabled Aug 30 00:01:06.272796 dv-cinder-815746-8-smb devstack@keystone.service[81648]: your server socket listen backlog is limited to 100 connections Aug 30 00:01:06.272796 dv-cinder-815746-8-smb devstack@keystone.service[81648]: your mercy for graceful operations on workers is 90 seconds Aug 30 00:01:06.273146 dv-cinder-815746-8-smb devstack@keystone.service[81648]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 00:01:06.273215 dv-cinder-815746-8-smb devstack@keystone.service[81648]: *** Operational MODE: preforking *** Aug 30 00:01:06.273497 dv-cinder-815746-8-smb devstack@keystone.service[81648]: *** uWSGI is running in multiple interpreter mode *** Aug 30 00:01:06.273497 dv-cinder-815746-8-smb devstack@keystone.service[81648]: spawned uWSGI master process (pid: 81648) Aug 30 00:01:06.273700 dv-cinder-815746-8-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 30 00:01:06.277735 dv-cinder-815746-8-smb devstack@keystone.service[81648]: spawned uWSGI worker 1 (pid: 81661, cores: 1) Aug 30 00:01:06.277735 dv-cinder-815746-8-smb devstack@keystone.service[81648]: spawned uWSGI worker 2 (pid: 81662, cores: 1) Aug 30 00:01:06.277735 dv-cinder-815746-8-smb devstack@keystone.service[81648]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 00:01:10.627692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:01:10.627692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: from cryptography.utils import int_from_bytes Aug 30 00:01:10.628542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:01:10.628542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: from cryptography.utils import int_from_bytes Aug 30 00:01:10.628778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:01:10.628778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: from cryptography.utils import int_from_bytes Aug 30 00:01:10.629222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 00:01:10.629222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: from cryptography.utils import int_from_bytes Aug 30 00:01:10.678902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:01:10.679101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:01:10.679295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] command line args: [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:01:10.679564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:01:10.679744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ================================================================================ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:01:10.679828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 00:01:10.679954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 00:01:10.680043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] admin_token = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.680153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] command line args: [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 00:01:10.680236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config_dir = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.680402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.680477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 00:01:10.680584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] config_source = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.680660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ================================================================================ {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 00:01:10.680767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] debug = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.680849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] admin_token = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.680967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] config_dir = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] config_source = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] debug = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.681898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_config_append = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_dir = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.682995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_config_append = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_dir = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_file = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.683988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.684899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.685997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.686924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] publish_errors = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.687005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.687154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.687449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.687691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.687691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] publish_errors = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] standard_threads = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.688934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] standard_threads = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_journal = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_json = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_stderr = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] use_syslog = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] use_journal = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.689992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] use_json = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.690125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.690208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] use_stderr = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.690320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] use_syslog = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.690394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.690552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 00:01:10.690633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.690808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.690885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.691838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.692966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.693935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.694979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.695963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.696894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.697852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.698940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.699945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.700999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.701947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.702973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.703946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.704823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.705953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.706999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.707943 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.708891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.709849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.710949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.711971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.712891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.713970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.714932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.external = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.715986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.external = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.password = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] auth.token = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.716956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.password = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] auth.token = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.717923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.718046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.718173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.718275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.718406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.718509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.719259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.719348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.719548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.719675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.719783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.719899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.720850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.721850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722022 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.722885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.723989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.724938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.725920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.726952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.727933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.728870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.729986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.730982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.731997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732706 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.732950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.733952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.734087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.734165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.734986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.735979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.736944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.737930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738774 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.738852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.739957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.740971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.741936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.742881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.743971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.744985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.745959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.746898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.747891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.748978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.749912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.750980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] role.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] role.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.751951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.752921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.753993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.754970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.755918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.756927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.757915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.758070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.758158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.758296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.758373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.758530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.758607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.759963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.760920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.761972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.762968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.763899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.connection = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.764982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.765975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.766988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.767151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.767228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.767384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.767469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.767542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81661) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:01:10.767633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.767873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.768121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.768355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.768597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.768835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 00:01:10.769006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81662) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 00:01:10.798028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.798252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.798476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.798779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.799014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.799240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.806915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.807603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.834829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.835055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.835503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.835739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.888767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.889347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.938007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.938245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.940115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:10.940359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.093460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.093799 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.094056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.094283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.094504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.094635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.094725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.094870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.095094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.095313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.095530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.095747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.118317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.118425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.118556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.118656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.118790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.118874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.119752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.131271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.131399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.144975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81661) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.145812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81662) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 30 00:01:11.162140 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.162350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:01:11.162693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.162901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:01:11.163128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.163232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.163346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:01:11.163430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.163692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.163898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 30 00:01:11.163987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.164171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.164251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.164437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.164701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.164963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.174099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.174381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.174650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.174932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.175443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.175730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.176007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.176295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.181869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.183289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.184740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.185027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.185315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.185606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.185916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.186184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.186280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.186458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.186542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.186737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.186818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.187037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.187127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.187416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.187985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.188198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.188296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.188585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.188868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.189154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.189434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.189729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.211238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.212383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.212697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.212983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.213873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.214167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.217637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.217950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.218239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.218774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.219065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.219445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.224681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.224972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.225936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.226233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.229213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.229511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.229824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.230123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.230209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.230411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.230498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.230696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.230780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.230969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.231059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.231251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.231336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.233262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.233560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.233886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.249188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.249472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.251346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.251630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.254038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.255523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.257232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.257532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.258909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.259212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.262023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.263587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.265142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.266834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.268443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.268750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.269037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.269361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.269662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.269968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.270070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.270275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.270566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.270857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.271142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.271530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.285645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.285960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.286232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.286498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.287662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.287960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.288238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.288512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.293339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.294876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.295279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.296421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.297259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.297850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.299117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.299401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.299965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.300253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.300651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.300939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.301228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.302075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.302377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.302667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.302959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.303258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.313174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.313461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.313870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.314159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.314449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.314734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.315040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.315123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.315355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.315640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.315923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.316205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.316486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.316770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.330516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.333103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.333426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.336159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.336313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.337762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.339061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.339379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.339666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.339957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.340521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.342094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.342387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.342678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.346726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.348206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.349278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.350803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.351204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.351506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.351802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.352094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.353665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.353988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.354283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.354565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.360486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.360779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.361064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.363123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.363419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.363704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.367936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81661) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.368229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.368517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.368806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.369079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.369358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.369633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.369934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.370216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.370494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.370596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81662) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 30 00:01:11.370766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.370886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.371031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.371172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.371297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.371455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.371576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81661) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.371734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.372011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.372297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.372575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.372858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.373140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.373415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.373679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.373973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.374258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81662) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 30 00:01:11.408022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636606bb9c0 pid: 81661 (default app) Aug 30 00:01:11.409386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636606bb9c0 pid: 81662 (default app) Aug 30 00:01:11.411275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83973fae-d5b0-4f98-893e-415b2e7b94cd None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:11.411566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83973fae-d5b0-4f98-893e-415b2e7b94cd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:11.411839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83973fae-d5b0-4f98-893e-415b2e7b94cd None None] PATH_INFO: `/v3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:11.416018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Aug 30 00:01:11 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:18.014414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:18.014939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:18.015046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:18.019802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:01:18.025196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:18.025627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:18.025788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:18.096726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: INFO dbcounter [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] Registered counter for database keystone Aug 30 00:01:18.116083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG oslo_db.sqlalchemy.engines [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81661) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:01:18.122284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writer thread running {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:01:18.303022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG passlib.handlers.bcrypt [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81661) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:01:18.303335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG passlib.handlers.bcrypt [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81661) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:01:18.361401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:18.363037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:18.491877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 30 00:01:18.983478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:19.053061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: INFO dbcounter [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] Registered counter for database keystone Aug 30 00:01:19.074469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG oslo_db.sqlalchemy.engines [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81662) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 00:01:19.081393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writer thread running {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 00:01:19.201102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fbee9-5312-49bd-ab9c-2da4d2bfe1a7 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:19.206001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:19.206621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:19.206903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:19.207178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:19.215359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:19.269752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING keystone.common.rbac_enforcer.enforcer [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:01:19.270105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bae7db-35bf-4d37-804f-bbf53ff40922 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:19.280281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Aug 30 00:01:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:19.286302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:19.301061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450064ef-5d3d-4739-bb08-45e476fa89af None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:19.305422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:19.306567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:19.306855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:19.307131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] PATH_INFO: `/v3/projects/d5371435029143138d8fb9e32ebf3198` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:19.308699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5371435029143138d8fb9e32ebf3198)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:19.362064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING keystone.common.rbac_enforcer.enforcer [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 30 00:01:19.362410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762fc215-484f-420a-b705-70076afc5007 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:19.366908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Aug 30 00:01:19 2022] GET /identity/v3/projects/d5371435029143138d8fb9e32ebf3198 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:21.298366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84968200-1599-4de3-9f70-e4ead8c85ebe None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:21.298864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84968200-1599-4de3-9f70-e4ead8c85ebe None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:21.298864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84968200-1599-4de3-9f70-e4ead8c85ebe None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:21.302960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:21.308433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:21.308855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:21.308990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:21.329183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:21.330747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:21.338609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 30 00:01:21.618914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84968200-1599-4de3-9f70-e4ead8c85ebe None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:21.631585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84968200-1599-4de3-9f70-e4ead8c85ebe None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:21.636084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2a928-b8fd-47a9-8cee-11b4cff465ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:21.636678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a928-b8fd-47a9-8cee-11b4cff465ba admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:21.636966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a928-b8fd-47a9-8cee-11b4cff465ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:21.637248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a928-b8fd-47a9-8cee-11b4cff465ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:21.646289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2a928-b8fd-47a9-8cee-11b4cff465ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:21.648062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2a928-b8fd-47a9-8cee-11b4cff465ba admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:21.657739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Aug 30 00:01:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:01:21.663495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:21.672861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433383c-af44-41a4-89b9-c7fd2276dce1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:21.677239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167d03d-cd82-4279-b56b-8d76b8a60822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:21.677894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d03d-cd82-4279-b56b-8d76b8a60822 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:21.678184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d03d-cd82-4279-b56b-8d76b8a60822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:21.678465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167d03d-cd82-4279-b56b-8d76b8a60822 admin admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:21.679788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d03d-cd82-4279-b56b-8d76b8a60822 admin admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:21.681621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167d03d-cd82-4279-b56b-8d76b8a60822 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:21.683177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Aug 30 00:01:21 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:23.692060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fe7b-8ad5-4d95-84e9-4c0bf61d230d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:23.692608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fe7b-8ad5-4d95-84e9-4c0bf61d230d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:23.692780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fe7b-8ad5-4d95-84e9-4c0bf61d230d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:23.694159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:23.699346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:23.699727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:23.699909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:23.718751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:23.719954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:23.727843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd524fb-c1e0-415c-b8c6-d2b6cd3f970c None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:23.728133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd524fb-c1e0-415c-b8c6-d2b6cd3f970c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:23.728413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd524fb-c1e0-415c-b8c6-d2b6cd3f970c None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:23.729760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:01:23.735191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:23.735481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:23.735759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:23.778478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG passlib.handlers.bcrypt [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81662) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 30 00:01:23.778694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG passlib.handlers.bcrypt [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81662) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 30 00:01:23.802969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:23.828144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:23.829758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:23.934663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:24.076013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.099876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.184031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaef74-f12f-4a27-8136-93ef4c4e65e5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.207754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.218094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.218739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.219027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.219306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.230732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:24.240286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:24.241223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:24.242083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:24.247247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.310607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f3cb5e-65ed-415b-9e6f-1a15ba539292 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.313214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.333690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.352816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee137df5-9b5c-4692-add5-c7c495da74ce None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.353479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.354384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.354672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.354959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.387985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.388601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.388905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.389182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.389892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:24.390199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.391599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.403209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:24.409403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.423883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.425411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.507973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8fd44-f717-49ff-9ed8-0cae6eb259a1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.524814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:24.531385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.535049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.542407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.543044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.543332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.544333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.545607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.547147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.548743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:24.554253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.568987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.633193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167086-2312-4adc-b86f-65b00a720c3a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.658775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248cc2f8-fac5-4832-a41b-565fb09b2e7b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.667727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.668693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.668874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.669148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.690288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.691774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.694346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.695079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.695369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.695644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.696797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.698282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.706382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:24.707301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:01:24.711003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:24.712144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:01:24.712915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:01:24.712915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:01:24.712915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:24.712915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:01:24.718709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:24.775377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.789928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:24.814097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e00fd-1106-4342-85b5-0cda86b731ce None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.830379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00652059-5c72-41be-b46b-e082d598d8c1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:24.850755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.851606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.852118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.852641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.853440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.domain.id=default, user.id=87f9b76a136e4875a30812fb5a16d50e) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:24.853785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.855267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340318aa-c856-413f-bb83-b2bba047e70e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.862840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/role_assignments?user.id=87f9b76a136e4875a30812fb5a16d50e&scope.domain.id=default&role.id=46ba8574dccb497790ae947ec68f522d => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:24.870317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:24.870955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:24.871240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:24.871521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:24.872208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:24.872519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:24.874887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea914a-be8b-48a0-b858-933920893486 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:24.898605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:01:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:27.051272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a37d-aaa0-4c8d-90a4-52245cbc4f01 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.052237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a37d-aaa0-4c8d-90a4-52245cbc4f01 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.052729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204a37d-aaa0-4c8d-90a4-52245cbc4f01 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.054294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:27.059715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428476f9-db2c-45b0-8086-4c217238f541 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.060579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428476f9-db2c-45b0-8086-4c217238f541 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.061097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428476f9-db2c-45b0-8086-4c217238f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.085241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-428476f9-db2c-45b0-8086-4c217238f541 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:27.086763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-428476f9-db2c-45b0-8086-4c217238f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:27.171228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:27.575954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90a1-af04-4d5a-8dc8-03465f3e8891 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.576805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90a1-af04-4d5a-8dc8-03465f3e8891 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.577290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90a1-af04-4d5a-8dc8-03465f3e8891 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.578867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:27.595838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543716-8c31-4184-b46c-0c8b9822baac None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.596123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543716-8c31-4184-b46c-0c8b9822baac None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.596400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df543716-8c31-4184-b46c-0c8b9822baac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.622734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-df543716-8c31-4184-b46c-0c8b9822baac None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:27.624644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-df543716-8c31-4184-b46c-0c8b9822baac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:27.652921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90a1-af04-4d5a-8dc8-03465f3e8891 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:27.688906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:27.722127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:27.723858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead251-7385-42b6-92b9-0ff73442d7b9 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.724301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead251-7385-42b6-92b9-0ff73442d7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.724721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ead251-7385-42b6-92b9-0ff73442d7b9 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.726117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 13/26] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:27.737749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009544-46c3-4a4b-abc7-53ae3eeaa581 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.737749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009544-46c3-4a4b-abc7-53ae3eeaa581 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.737749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b009544-46c3-4a4b-abc7-53ae3eeaa581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.768687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4b009544-46c3-4a4b-abc7-53ae3eeaa581 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:27.769931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4b009544-46c3-4a4b-abc7-53ae3eeaa581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:27.879398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90a1-af04-4d5a-8dc8-03465f3e8891 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:27.907672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 14/27] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:27.908945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723be67-6508-4c38-a50d-417703834af0 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.909238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723be67-6508-4c38-a50d-417703834af0 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.909517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723be67-6508-4c38-a50d-417703834af0 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.911047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 15/28] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:27.922991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:27.923727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.924062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.924393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.926930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:27.927387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:27.927815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:27.936537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:27.938231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:27.940930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:01:27.956152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:27.957015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:01:27.957994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:01:27.957994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:01:27.957994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:27.960146 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:01:27.965125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:27.975853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:27.978705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:28.064938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 16/30] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:28.067671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:28.144191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:28.184524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a58df9-e304-4c84-9523-0d1bca886372 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:28.260014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:28.260629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.260910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.261182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.261863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:28.262167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:28.264789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:28.273452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2680e8-2a80-4422-829d-4f5cae9a24ca None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:28.301003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 15/31] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:01:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:28.302301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:28.326982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:28.328899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.329574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.331129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.332214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:28.334699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:28.402014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:28.475229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33cd1b8-78fe-497d-8af0-d3b2289117cb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:28.506290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 17/32] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 00:01:28 2022] POST /identity/v3/roles => generated 219 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:28.507995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:28.524044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:28.525097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.525581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.526092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.559896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:28.565766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:28.566656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:28.567379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:28.569769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 16/33] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:28.570822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:28.693344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:28.702826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480090f2-a7e7-4ca7-8c49-8ddd04ac10b8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:28.750175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:28.750990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9741d0-c0c7-43c5-bb57-b42a394b3f59 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:28.751226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.751643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.752065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.753150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:28.754952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:28.769590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:28.791248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68791148-d3e1-455a-9a59-1d96c9075737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:28.791435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 18/34] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:01:28 2022] POST /identity/v3/projects => generated 301 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:28.791973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791148-d3e1-455a-9a59-1d96c9075737 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.792318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791148-d3e1-455a-9a59-1d96c9075737 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.792431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:28.792585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68791148-d3e1-455a-9a59-1d96c9075737 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.793321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68791148-d3e1-455a-9a59-1d96c9075737 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:28.795571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68791148-d3e1-455a-9a59-1d96c9075737 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:28.918962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480e973-215a-4a82-8ed5-4753da5951d8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:28.930147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 17/35] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 00:01:28 2022] POST /identity/v3/roles => generated 225 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:28.931973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46d68-d5bb-448e-942a-ebd822524a13 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.931973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46d68-d5bb-448e-942a-ebd822524a13 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.932553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f46d68-d5bb-448e-942a-ebd822524a13 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.933530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 18/36] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:28.939617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266e995-f6c7-4bda-bdfa-fd955dab51f5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.939958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266e995-f6c7-4bda-bdfa-fd955dab51f5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.940314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8266e995-f6c7-4bda-bdfa-fd955dab51f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.962632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8266e995-f6c7-4bda-bdfa-fd955dab51f5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:28.963053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:28.963981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:28.964410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:28.964529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8266e995-f6c7-4bda-bdfa-fd955dab51f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:28.964929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:28.965892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:28.966996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:28.969367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:28.985508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 19/37] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:28.991281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.006162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.071533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 19/38] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:29.075573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307d43e-bcd5-4ed2-a639-0d6037f42685 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.075573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307d43e-bcd5-4ed2-a639-0d6037f42685 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.076395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2307d43e-bcd5-4ed2-a639-0d6037f42685 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.077836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 20/39] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:29.084652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.085287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.085815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.110562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:29.112225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:29.135086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a6162c-cd54-40f1-b5cb-5510d2b0a08c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.188435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.189087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.189375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.189658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.191186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.192839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:29.199769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 20/40] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:28 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:29.201455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.207619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 21/41] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:29.287146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.309489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51303-35e6-4fc3-8a53-4810e6d49816 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.344763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.345402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.345692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.346009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.347135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.348584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:29.350373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 21/42] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:29.355830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.361031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.398714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.469428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42379d1d-cac0-4996-98f9-03c3d61d6f34 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.470677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cdf565-52d0-4a1d-9a8f-fbe51521290f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.504542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.505392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.505682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.505991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.506082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.506669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.506759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.506987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.507516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] PATH_INFO: `/v3/domains/default/users/87f9b76a136e4875a30812fb5a16d50e/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.508312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:29.509420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=87f9b76a136e4875a30812fb5a16d50e, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.511302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:29.524420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 22/43] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 00:01:29 2022] POST /identity/v3/roles => generated 223 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:29.524964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 22/44] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Aug 30 00:01:29 2022] PUT /identity/v3/domains/default/users/87f9b76a136e4875a30812fb5a16d50e/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:29.525238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.538463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.660354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5304fa-637b-445d-a4f9-efc68ba1cc4d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.707608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce85fc-09e5-4744-8199-b7a4b393218d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.708251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce85fc-09e5-4744-8199-b7a4b393218d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.708535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce85fc-09e5-4744-8199-b7a4b393218d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.708810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce85fc-09e5-4744-8199-b7a4b393218d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.710232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce85fc-09e5-4744-8199-b7a4b393218d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.713204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce85fc-09e5-4744-8199-b7a4b393218d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:29.716184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 23/45] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:29.722036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:29.820740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:29.827208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf6b01-df3e-4484-8a00-4a1a68302d32 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:29.860714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00e597b-9637-4a1c-a357-2d7304f00423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:29.861322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e597b-9637-4a1c-a357-2d7304f00423 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:29.861608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e597b-9637-4a1c-a357-2d7304f00423 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:29.861919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00e597b-9637-4a1c-a357-2d7304f00423 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:29.862583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e597b-9637-4a1c-a357-2d7304f00423 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:29.864032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00e597b-9637-4a1c-a357-2d7304f00423 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:29.893645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:01:29 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:31.443076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d396f-0a65-4d0f-a3a2-630af845aa34 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.443612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d396f-0a65-4d0f-a3a2-630af845aa34 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.443707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d396f-0a65-4d0f-a3a2-630af845aa34 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.444995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 24/47] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:31.450900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889344-9195-449a-995f-ea052896c80c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.451404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889344-9195-449a-995f-ea052896c80c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.451488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e889344-9195-449a-995f-ea052896c80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.577787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4e889344-9195-449a-995f-ea052896c80c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:31.578998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4e889344-9195-449a-995f-ea052896c80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:31.649910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:31.815101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb50c0-2515-4ae1-b2fd-bf13389f1ad9 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.815322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb50c0-2515-4ae1-b2fd-bf13389f1ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.815608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb50c0-2515-4ae1-b2fd-bf13389f1ad9 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.816970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 25/49] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:31.822116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:31.822416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:31.822695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:31.841639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:31.842858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:31.908110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 25/50] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:31.917278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb50c0-2515-4ae1-b2fd-bf13389f1ad9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:31.993391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.019796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb50c0-2515-4ae1-b2fd-bf13389f1ad9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.052393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.053016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.053304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.053580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.065803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:32.071788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:32.072583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:32.073321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 26/51] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:32.078878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.089399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.179465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a4e87-4bec-45ba-b05f-394dd3148433 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.182876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.214883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.215493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.215775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.216080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.216918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:32.217232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.218675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.226832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 26/52] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:32.233219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.291428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc95b2-056e-4ec2-8db6-c7320b4278b3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.303290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.325529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.326104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.326397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.326673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.327774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.329217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.330808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 27/53] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:32.335824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dff6b0-7e37-4d05-8b20-8d28033e9f8e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.336198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.338779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.371642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.372895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.373188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.373467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.374768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.376270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.377968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 27/54] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:32.384115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.488298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2865e-7086-4292-b811-81c05c3b4428 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.520867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.521495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.521809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.522083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.523201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.524643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.526231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:32.532458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:32.541508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:32.544801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08442c8b-05b1-49f4-9c9c-a8ef9be138ac None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.578350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4af76-080b-44a4-a19b-828581555d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.578883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4af76-080b-44a4-a19b-828581555d43 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.579167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4af76-080b-44a4-a19b-828581555d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.579443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4af76-080b-44a4-a19b-828581555d43 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.580095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4af76-080b-44a4-a19b-828581555d43 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.582259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4af76-080b-44a4-a19b-828581555d43 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.608873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 28/56] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Aug 30 00:01:32 2022] POST /identity/v3/projects => generated 298 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:32.640467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebef2534-39e5-4a0c-a756-0551713aef3a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:32.677830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:32.678450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:32.678739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:32.679017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:32.679808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.domain.id=default, user.id=87f9b76a136e4875a30812fb5a16d50e) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:32.680123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:32.681607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e5ed1-0e83-433b-a5c0-d2b2d6fee994 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:32.688996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 29/57] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Aug 30 00:01:32 2022] GET /identity/v3/role_assignments?user.id=87f9b76a136e4875a30812fb5a16d50e&scope.domain.id=default&role.id=46ba8574dccb497790ae947ec68f522d => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:34.544562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280d28f-b75e-4afc-ade7-60329d8b684e None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:34.545106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280d28f-b75e-4afc-ade7-60329d8b684e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:34.545194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4280d28f-b75e-4afc-ade7-60329d8b684e None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:34.546566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 29/58] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:34.551714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:34.552109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:34.552285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:34.570871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:34.572058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:34.634898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:34.639845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:34.906917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280d28f-b75e-4afc-ade7-60329d8b684e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:34.962378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:35.008609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4280d28f-b75e-4afc-ade7-60329d8b684e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:35.041238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff13ac-88b8-4a9b-9745-fc2a49501413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:35.041886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff13ac-88b8-4a9b-9745-fc2a49501413 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:35.042174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff13ac-88b8-4a9b-9745-fc2a49501413 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:35.042447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff13ac-88b8-4a9b-9745-fc2a49501413 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:35.043559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff13ac-88b8-4a9b-9745-fc2a49501413 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:35.045137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff13ac-88b8-4a9b-9745-fc2a49501413 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:35.046731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 30/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:35.052241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:35.150316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201053f-7e81-4b93-aebc-0be5f6aa37d0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:35.182972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a44fc8-6a2a-456b-b8aa-6236e1080f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:35.183508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44fc8-6a2a-456b-b8aa-6236e1080f18 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:35.183793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44fc8-6a2a-456b-b8aa-6236e1080f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:35.184070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44fc8-6a2a-456b-b8aa-6236e1080f18 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:35.184756 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44fc8-6a2a-456b-b8aa-6236e1080f18 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:35.186227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44fc8-6a2a-456b-b8aa-6236e1080f18 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:35.212396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:01:35 2022] POST /identity/v3/users => generated 275 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:38.265617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af765-35a1-4304-b20e-03ee279706ee None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.266109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af765-35a1-4304-b20e-03ee279706ee None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.266388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0af765-35a1-4304-b20e-03ee279706ee None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.267865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 31/62] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:38.272926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142bd61-2cad-45d3-8dad-59bde17fdcc2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.273319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142bd61-2cad-45d3-8dad-59bde17fdcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.273572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4142bd61-2cad-45d3-8dad-59bde17fdcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.298815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4142bd61-2cad-45d3-8dad-59bde17fdcc2 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:38.300041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4142bd61-2cad-45d3-8dad-59bde17fdcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:38.366781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:38.390319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 32/63] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:38.433006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3588d-6499-49c3-9472-b33b57768fce None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.433300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3588d-6499-49c3-9472-b33b57768fce None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.433588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a3588d-6499-49c3-9472-b33b57768fce None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.435936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 32/64] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:38.437908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966ac88-c123-4647-bdc3-9730014ce547 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.438201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966ac88-c123-4647-bdc3-9730014ce547 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.438484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966ac88-c123-4647-bdc3-9730014ce547 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.440582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a06ba-28a2-4331-b6b3-ccdb62483cf8 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.440874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a06ba-28a2-4331-b6b3-ccdb62483cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.441155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a06ba-28a2-4331-b6b3-ccdb62483cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.445149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 33/65] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:38.451264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39764685-49bf-4060-acad-84cb1105ba4d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.451555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39764685-49bf-4060-acad-84cb1105ba4d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.451844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39764685-49bf-4060-acad-84cb1105ba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.470502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b61a06ba-28a2-4331-b6b3-ccdb62483cf8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:38.472339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b61a06ba-28a2-4331-b6b3-ccdb62483cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:38.480488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-39764685-49bf-4060-acad-84cb1105ba4d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:38.482608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-39764685-49bf-4060-acad-84cb1105ba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:38.612697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 33/66] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:38.623926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 34/67] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:38.756147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdc909-2e4d-40df-96a2-9467cc6d43b3 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.756719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdc909-2e4d-40df-96a2-9467cc6d43b3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.756979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdc909-2e4d-40df-96a2-9467cc6d43b3 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.758391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 34/68] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:38.767311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688af3c-1514-4d7f-a2de-70ba10af964a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.767580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688af3c-1514-4d7f-a2de-70ba10af964a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.767861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3688af3c-1514-4d7f-a2de-70ba10af964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.793194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3688af3c-1514-4d7f-a2de-70ba10af964a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:38.794990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3688af3c-1514-4d7f-a2de-70ba10af964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:38.808155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdc909-2e4d-40df-96a2-9467cc6d43b3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:38.886887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:38.913741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 35/69] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:38.919399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b483-cd94-4995-a6a1-410d3e8728eb None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.919837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b483-cd94-4995-a6a1-410d3e8728eb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.920305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220b483-cd94-4995-a6a1-410d3e8728eb None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:38.921841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 36/70] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:38.922762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b483-cd94-4995-a6a1-410d3e8728eb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:38.948132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdc909-2e4d-40df-96a2-9467cc6d43b3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:38.982696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:38.989906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1fd6a-a38f-466e-8917-59ec9b685d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:38.990554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1fd6a-a38f-466e-8917-59ec9b685d47 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:38.990851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1fd6a-a38f-466e-8917-59ec9b685d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:38.991125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1fd6a-a38f-466e-8917-59ec9b685d47 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.002124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1fd6a-a38f-466e-8917-59ec9b685d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1dd1fd6a-a38f-466e-8917-59ec9b685d47 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:39.007386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:39.008209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:39.009747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 35/71] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:39.010376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.010766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.010766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.028931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:39.030176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:39.044424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220b483-cd94-4995-a6a1-410d3e8728eb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.080464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.081329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.081789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.082221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.092861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:39.097746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:39.098570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:39.099291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 37/72] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:39.100548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.105064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 36/73] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:39.106517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.154334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.222577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10efc8df-cc45-4b23-abb0-66c7dfb1f2a8 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.234574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a451c-4f7a-49ce-8041-a16cbc4796ae None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.242649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.259260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.259872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.260154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.260467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.261145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:39.261455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.263177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.271570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 37/74] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.272370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.272673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.273499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.274017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.274087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.287151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:39.292073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:39.292885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:39.293673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:39.294319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.389960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b117c5a-7264-44e6-a764-82a0a7123c29 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.392367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.399972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31d689d-013b-4576-9ece-b2ce081e2aec None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.425428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.426001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.426286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.426561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.427225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:39.427533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.428891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.434356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.435085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.435372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.435641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.437214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.437819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.449469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:39.454554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:39.455573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:39.456371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:39.456989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.485782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.540001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb7360a-fe06-41d3-8573-281ccaf9f1f6 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.558905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c015c-60b6-40bc-8344-d7ab8f434547 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.573430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.574090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.574375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.575271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.589884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.591895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.593421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.593537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.594315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.597054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.597340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.597626 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.598346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:39.598662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.600053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.608629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.609430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.621953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.698301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.699277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8cc5a-4021-4bf7-9ff0-ffc535c911a8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.712755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66c919-2149-4c08-8ca7-8b444fbc253d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.734335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.734964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.735245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.735519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.736631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.738102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.739784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.740615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.749150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.749811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.750096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.750371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.751498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.752947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.754686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.755316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.839566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.849788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43c0e8-080d-4149-8d5d-f2f13fab1af2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.861422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a894d-11ef-43ff-92d9-b20dfdbed704 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:39.883979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.884595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.884886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.885171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.885902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:39.886217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.888219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:39.896070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 41/82] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:39.896181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:39.896763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:39.897052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:39.897329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:39.897728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:39.926510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:39.971425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:39.972840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.003208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63463f7-fa78-4798-93e9-ce14a91978f2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.038623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.039260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.039550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.039833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.040994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.042485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.044403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 42/83] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:40.045156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.070200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.075186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 42/84] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.076180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.130327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.151673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772737d-9ca1-4fd5-b191-00d4a626a36e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.175662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f66a6-0c86-467b-bb1e-06a0ac387d57 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.186411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.187024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.187312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.187593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.188254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.189727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.210242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.210851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.211140 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.211416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.216869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 43/85] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:01:40 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:40.217695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.291213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.294716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.322811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.350361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab06e4b-3bf8-4dff-9478-8835f7b296db None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.359666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.392696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.393345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.393631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.394000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.395836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.396612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.403189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 44/86] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:40.403189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.419642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 43/87] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.420817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.535541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d6737-5374-42ac-831a-262153bbd881 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.537301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596166d8-2125-4673-a76d-3871874f8d17 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.577042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.577601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.578090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.578380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.578651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.579375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.579564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.579718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.579984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.580998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.582749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 44/88] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:40.583645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.600210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.611433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.665415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.667265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.714562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46909fbc-d583-4f34-8f7a-dfd35d9588be None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.761029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.761990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.762607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.763114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.793879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 45/89] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.795131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.837420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.839222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.858153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.867259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:40.935473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a47b2d-207f-4a51-a06b-97fafe620e4b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:40.959199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 45/90] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:40.960918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:40.975718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:40.976356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:40.976643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:40.976923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:40.978097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:40.979567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:40.981885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 46/91] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:40.982903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:41.079007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25e10f-07c5-4596-83ab-f997e1261f0e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.104642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:41.118212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.118910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.119089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.119371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.120105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=29687ec14c104869a1721c16fabdef06) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:41.120418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.122718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.123256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2e061-3c7d-46e4-babf-cc667890a0d0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.134110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 46/92] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/role_assignments?user.id=29687ec14c104869a1721c16fabdef06&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:41.135098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:41.140782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:41.169661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.170881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.171366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.172144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.173512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.175786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.178278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 47/93] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:40 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:41.179521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:41.312367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb5965e-5524-4968-933b-cad8cca60fe9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.359080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.359785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.359981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.360276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.361027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=87f9b76a136e4875a30812fb5a16d50e) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:41.361342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.363203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.375452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 48/94] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:41 2022] GET /identity/v3/role_assignments?user.id=87f9b76a136e4875a30812fb5a16d50e&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:41.376403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:41.389312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423373f1-4225-46bc-98b3-0961e068d035 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.436345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:41.470352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.471061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.471349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.471631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] PATH_INFO: `/v3/projects/ec0e45d8deb94cc694a3aef58750d58e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.478800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] RBAC: Authorizing `identity:get_project(project_id=ec0e45d8deb94cc694a3aef58750d58e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.480400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.483329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 47/95] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:41 2022] GET /identity/v3/projects/ec0e45d8deb94cc694a3aef58750d58e => generated 312 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:41.499439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:41.511345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba4488-5145-4983-8e4d-c507491a2b04 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.556557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.557558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.557943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.558821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.559783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] RBAC: Adding query filter params (role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=29687ec14c104869a1721c16fabdef06) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:41.560182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.561918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5364755-d519-41fe-88e2-a9d403a6a099 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.569898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:41 2022] GET /identity/v3/role_assignments?user.id=29687ec14c104869a1721c16fabdef06&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=ca37184ac9034a398797d8994e2ce144 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:41.611544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:41.680851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71567d-973b-4cb8-a8d0-93afaf7fba0a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:41.732523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:41.733216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:41.733510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:41.733820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:41.734586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=ec0e45d8deb94cc694a3aef58750d58e, user.id=29687ec14c104869a1721c16fabdef06) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:41.734948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:41.736441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23fb343-421b-4f3e-87a1-917761a3eeeb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:41.746440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:41 2022] GET /identity/v3/role_assignments?user.id=29687ec14c104869a1721c16fabdef06&scope.project.id=ec0e45d8deb94cc694a3aef58750d58e&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:42.685776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885154b4-2c4a-41d9-8455-59f8e6a61b20 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.686468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885154b4-2c4a-41d9-8455-59f8e6a61b20 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.686468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885154b4-2c4a-41d9-8455-59f8e6a61b20 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.687670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:42.693381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.693820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4d6a-f7dc-4bf7-afa1-7e234b3c676d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.693820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4d6a-f7dc-4bf7-afa1-7e234b3c676d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.693942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a4d6a-f7dc-4bf7-afa1-7e234b3c676d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.694529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.695024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.695376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 51/99] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:01:42.704054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:42.704638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:42.705106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:42.725266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:42.726740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:42.735753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:42.737119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:42.847313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 49/100] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:42.860051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 52/101] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:43.400784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:43.412135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:43.465542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:43.481729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:43.591247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707e1cd7-ea26-4a85-9bf4-dd5ecdb2309f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.612635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f06f3-54b3-4018-ae82-692c268de717 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.667105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:43.667687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:43.668590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:43.668962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:43.674442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:43.674992 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:43.675642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:43.675926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:43.676036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:43.676203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:43.677566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 53/102] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:43.683115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:43.694964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:43.706324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:43.707169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:01:43.707995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:43.709546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 50/103] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:43.714615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:43.871093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830773-52a6-4c06-b7b5-f7befb67229c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.894089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:43.936726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad1f3e-2c4f-4747-980c-6b4dffc38e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:43.937352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1f3e-2c4f-4747-980c-6b4dffc38e91 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:43.937644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1f3e-2c4f-4747-980c-6b4dffc38e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:43.937956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad1f3e-2c4f-4747-980c-6b4dffc38e91 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:43.938624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad1f3e-2c4f-4747-980c-6b4dffc38e91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:43.940107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad1f3e-2c4f-4747-980c-6b4dffc38e91 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:43.967507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb777e6-326f-48b1-9950-90afde6aff4a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:43.990097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.023440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 54/104] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:01:43 2022] POST /identity/v3/projects => generated 302 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:01:44.024598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5af8b2-0dd6-4afe-90bf-54e4d55c9527 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.024912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5af8b2-0dd6-4afe-90bf-54e4d55c9527 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.025271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5af8b2-0dd6-4afe-90bf-54e4d55c9527 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.026562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.026849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 55/105] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:44.028549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.029055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.029543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.030520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:44.031047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.032853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.035733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b20f4-d60a-4ef1-949d-5bc0fa51689b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.036026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b20f4-d60a-4ef1-949d-5bc0fa51689b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.036313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b20f4-d60a-4ef1-949d-5bc0fa51689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.044821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 51/106] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:44.060817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.066619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-162b20f4-d60a-4ef1-949d-5bc0fa51689b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:44.073724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-162b20f4-d60a-4ef1-949d-5bc0fa51689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.191379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 56/107] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:44.192836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92040e-2e2a-4462-8da7-0ff742852425 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.232209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.233206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.233744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.234297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] PATH_INFO: `/v3/users/c91c516592a744e2a0e9153262700f78` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.236008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89df9f-111d-428e-b05b-8039e2307087 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.236276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89df9f-111d-428e-b05b-8039e2307087 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.236564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab89df9f-111d-428e-b05b-8039e2307087 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.238097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 57/108] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:01:44.245089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b261d-afa0-447d-bd65-4a63be15a37a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.245402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b261d-afa0-447d-bd65-4a63be15a37a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.245659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38b261d-afa0-447d-bd65-4a63be15a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.255327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] RBAC: Authorizing `identity:get_user(user_id=c91c516592a744e2a0e9153262700f78)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.257554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.259533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 52/109] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/users/c91c516592a744e2a0e9153262700f78 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:44.266766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.272071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c38b261d-afa0-447d-bd65-4a63be15a37a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:44.274738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c38b261d-afa0-447d-bd65-4a63be15a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.316528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.363062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 58/110] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:44.413555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f57af9-8acf-4509-9848-3c8c4e05c28b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.424395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76591c4b-db50-4c2f-b771-b892b8791b5b None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.424688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76591c4b-db50-4c2f-b771-b892b8791b5b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.424973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76591c4b-db50-4c2f-b771-b892b8791b5b None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.426417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 59/111] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:01:44.431268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.431568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.431901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.461317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:44.462500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:44.490314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.491029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.491323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.491603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.493214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.589028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 60/112] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:44.589554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.612395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.617982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.663923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.694756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe67720c-d345-4962-81e5-175e820288e9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.731386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.732078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.732463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.732840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:44.749747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:44.750717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:44.751698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:44.753072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 61/113] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:44.758423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.790087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.800320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 53/114] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:44.801771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.911467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2060f5-d6a7-43d0-8897-4d71cb516c44 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.921733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192b0f4-8d65-4bd1-9289-449165e5170c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:44.958145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:44.963794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.964625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:44.966327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.967290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.967483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:44.967579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.968055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:44.968255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:44.968571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:44.968875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:44.969993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:44.980242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 54/115] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:44.981446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:44.982066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:44.987373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:44.988207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:44.988936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 62/116] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:44.989555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.065411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.093878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf22e849-333b-463f-b2e6-77a69c82a0c2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.101733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b41a5-22f1-492e-8f86-73a36e5aa12c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.129750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.130381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.130674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.130957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.132446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.133863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.140749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 55/117] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.140749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.145302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.145977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.146268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.146549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.157458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:45.162219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:45.163082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:45.163855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 63/118] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:01:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:45.164476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.212892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.257767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149afdbd-71a3-4425-97d4-d1f84d9fee47 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.279256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c18f6a-c6cb-4f60-924b-27408f1560f4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.293030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee77e4e-bffc-4a54-9cea-d1cbb07271e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.293770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77e4e-bffc-4a54-9cea-d1cbb07271e4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.294058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77e4e-bffc-4a54-9cea-d1cbb07271e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.294337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee77e4e-bffc-4a54-9cea-d1cbb07271e4 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.295465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee77e4e-bffc-4a54-9cea-d1cbb07271e4 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.296911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee77e4e-bffc-4a54-9cea-d1cbb07271e4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.298512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 56/119] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.299655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f4308-564f-44b3-948b-bd892128347b None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.299893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f4308-564f-44b3-948b-bd892128347b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.300168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f4308-564f-44b3-948b-bd892128347b None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.301616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 57/120] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:45.302355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f4308-564f-44b3-948b-bd892128347b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.315138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.322633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.323249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.323537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.323819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.325190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:45.325506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.326943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.339744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 64/121] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.339744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.414108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f4308-564f-44b3-948b-bd892128347b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.440569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1895eb3-1f74-49eb-a256-cceba04edeae None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.443744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.456483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.457105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.457396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.457734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.458478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] RBAC: Adding query filter params (role.id=b5b4891f9d964c70b218a76d167f6a3c, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=c91c516592a744e2a0e9153262700f78) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:45.458801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.460279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.466047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 58/122] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/role_assignments?user.id=c91c516592a744e2a0e9153262700f78&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=b5b4891f9d964c70b218a76d167f6a3c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.466855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.490185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.491055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.491516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.492084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.493079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:45.493534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.495244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b3073-9b4f-49d9-a475-614d17641f56 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.505257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 65/123] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.507380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.507903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.508126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.530187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:45.531517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:45.595644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b720-307c-4cd1-8fd5-5f6cc4bd1550 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.601652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.616151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 66/124] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:45.617395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.656706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.658102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.658584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.659048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.660616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.662490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.664576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 59/125] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.665594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.754868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.773585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4cb6e-f17f-40b3-9b7b-dba183d14777 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.815358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.816280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.816695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.817099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.818386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.820554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.823000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 67/126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.829148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:45.845022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45177540-576f-4ad9-95f0-bcc78df3287d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.906112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:45.951258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda032d1-48b7-4cfd-9e73-78ed37034bcc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:45.954995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:45.955649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:45.955935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:45.956215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:45.957373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:45.958866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:45.960466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 60/127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:45.961232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.010048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.010726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.011017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.011302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/29687ec14c104869a1721c16fabdef06/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.014080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea83b074d1446f9c350a5375eada88, user_id=29687ec14c104869a1721c16fabdef06, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.015556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.045680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 68/128] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:45 2022] PUT /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/29687ec14c104869a1721c16fabdef06/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:46.054095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.074715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a4ef-754e-4609-8753-66d30d2d00b2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.106456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.117129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.117999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.118298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.118576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.119876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.122240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.125102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 61/129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:45 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:46.126171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.249749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a0cac-39ea-4216-ae55-45522b233632 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.271772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffc434-c2d2-48b0-8272-28752e07a31d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.285011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.285645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.286188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.286293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.288219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.289262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.290659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.296291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 69/130] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:46.296895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.317229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.318408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.318958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.319736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.333844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:46.340952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:46.341826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:46.342576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:46.344743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 62/131] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:46.345984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.417199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd44bf0-b57b-4e1c-b9b8-125133bfbedb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.427686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.454399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.455212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.455590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.455983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/87f9b76a136e4875a30812fb5a16d50e/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.458134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea83b074d1446f9c350a5375eada88, user_id=87f9b76a136e4875a30812fb5a16d50e, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.459818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.487410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 70/132] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:46 2022] PUT /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/87f9b76a136e4875a30812fb5a16d50e/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:46.489691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4118909-d66d-4a43-a610-bd5c33a516f3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.490741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.565867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.566764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.567192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.567838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/29687ec14c104869a1721c16fabdef06/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.571239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea83b074d1446f9c350a5375eada88, user_id=29687ec14c104869a1721c16fabdef06, role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.576100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.584696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.605790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 63/133] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:46 2022] PUT /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/29687ec14c104869a1721c16fabdef06/roles/ca37184ac9034a398797d8994e2ce144 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:46.667478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f335b-2351-421a-b26c-3a7ee83b5d6c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.707295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.708201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.708630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.709048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.709908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:46.710355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.711912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2a402-052b-463e-ae72-7e145f2cc7b0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.722327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 71/134] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:46.730864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:46.798903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1a910-c8bc-4aa8-9736-54a9d2de0604 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.799344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1a910-c8bc-4aa8-9736-54a9d2de0604 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.799743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1a910-c8bc-4aa8-9736-54a9d2de0604 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.801248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 72/135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:01:46.818747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.819118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.819492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.849764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:46.849764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:46.898183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b937e-8360-4f98-9372-373e76788e16 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:46.923731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:46.947291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:46.947938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:46.948224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:46.948500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:46.950552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:46.952029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:46.954766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 73/136] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:46.957882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 64/137] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:46.964491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:47.018091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:47.098378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c73b48-9aae-4a82-85df-69d773c03c84 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:47.135102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:47.135741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:47.136029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:47.136308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] PATH_INFO: `/v3/projects/ec0e45d8deb94cc694a3aef58750d58e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:47.137493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] RBAC: Authorizing `identity:get_project(project_id=ec0e45d8deb94cc694a3aef58750d58e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:47.138989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:47.140945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 74/138] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:46 2022] GET /identity/v3/projects/ec0e45d8deb94cc694a3aef58750d58e => generated 312 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:47.146627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:47.302182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543c3f9-c6ff-45f0-848a-1965b9ddc13c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:47.350629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:47.351207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:47.351493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:47.351768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] PATH_INFO: `/v3/projects/ec0e45d8deb94cc694a3aef58750d58e/users/29687ec14c104869a1721c16fabdef06/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:47.359063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] RBAC: Authorizing `identity:create_grant(project_id=ec0e45d8deb94cc694a3aef58750d58e, user_id=29687ec14c104869a1721c16fabdef06, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:47.360544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:47.378492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 65/139] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:47 2022] PUT /identity/v3/projects/ec0e45d8deb94cc694a3aef58750d58e/users/29687ec14c104869a1721c16fabdef06/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:47.451923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:47.569876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:47.578067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a672b9-da19-4766-9ac0-15220b4d241c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:47.626895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d837ca-283e-4ba9-b530-b58f82432703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:47.627535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d837ca-283e-4ba9-b530-b58f82432703 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:47.627821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d837ca-283e-4ba9-b530-b58f82432703 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:47.628108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d837ca-283e-4ba9-b530-b58f82432703 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:47.629244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d837ca-283e-4ba9-b530-b58f82432703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:47.630750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d837ca-283e-4ba9-b530-b58f82432703 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:47.632865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 75/140] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:47.640329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:47.711792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:47.774944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc9e2e-d5f7-49a6-9048-f7c26471065d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:47.815871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f4c87-733c-4d65-a8fd-1f966dd9b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:47.816495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4c87-733c-4d65-a8fd-1f966dd9b696 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:47.816777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4c87-733c-4d65-a8fd-1f966dd9b696 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:47.817051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f4c87-733c-4d65-a8fd-1f966dd9b696 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:47.817743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4c87-733c-4d65-a8fd-1f966dd9b696 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:47.819206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f4c87-733c-4d65-a8fd-1f966dd9b696 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:47.848289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 66/141] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:01:47 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:48.353880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f4a3-df6d-4972-b9f1-3375ff188d81 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:48.354884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f4a3-df6d-4972-b9f1-3375ff188d81 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:48.355923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121f4a3-df6d-4972-b9f1-3375ff188d81 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:48.357927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 76/142] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:48.363455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:48.364673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:48.365173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:48.389536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:48.391077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:48.486803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 67/143] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:48.806930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f4a3-df6d-4972-b9f1-3375ff188d81 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:48.942704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121f4a3-df6d-4972-b9f1-3375ff188d81 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:48.987032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770818b-4eef-4004-9d6c-3de23c3375c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:48.988030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770818b-4eef-4004-9d6c-3de23c3375c0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:48.988525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770818b-4eef-4004-9d6c-3de23c3375c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:48.988992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770818b-4eef-4004-9d6c-3de23c3375c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.004797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770818b-4eef-4004-9d6c-3de23c3375c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-e770818b-4eef-4004-9d6c-3de23c3375c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:49.010342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:49.011187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:01:49.011938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:49.014624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 77/144] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:49.020046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.054645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:49.137876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8145a-4e9b-43ef-bc83-dd1acae92a32 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.145946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142c564-7161-42f4-bb26-3d4b4f373a24 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.146588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142c564-7161-42f4-bb26-3d4b4f373a24 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.147062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142c564-7161-42f4-bb26-3d4b4f373a24 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.148636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 78/145] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:49.159260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3ff1-01e0-4e5b-a62e-597f606968e0 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.159846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3ff1-01e0-4e5b-a62e-597f606968e0 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.160335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b3ff1-01e0-4e5b-a62e-597f606968e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.185414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e15b3ff1-01e0-4e5b-a62e-597f606968e0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:49.188628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e15b3ff1-01e0-4e5b-a62e-597f606968e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:49.226160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.227207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.227687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.228176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.229052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:49.229562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.232057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:49.244654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:49.254905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 68/146] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:49.263237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.332219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 79/147] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:49.333472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d9ad-b42d-4e74-8e7f-34668374aaac None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.333784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d9ad-b42d-4e74-8e7f-34668374aaac None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.334062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6d9ad-b42d-4e74-8e7f-34668374aaac None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.335474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 80/148] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:49.342904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.343187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.343460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.383330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:49.384535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:49.452950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:49.479667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210799b2-abf9-4abc-ba9a-a53322f0d5b1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.516074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 81/149] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:49.548291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228267b8-36b8-41ef-ac80-5051ad536637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.548937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228267b8-36b8-41ef-ac80-5051ad536637 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.549224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228267b8-36b8-41ef-ac80-5051ad536637 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.549504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228267b8-36b8-41ef-ac80-5051ad536637 None admin] PATH_INFO: `/v3/users/c91c516592a744e2a0e9153262700f78` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.554407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228267b8-36b8-41ef-ac80-5051ad536637 None admin] RBAC: Authorizing `identity:get_user(user_id=c91c516592a744e2a0e9153262700f78)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.555894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228267b8-36b8-41ef-ac80-5051ad536637 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:49.557716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 69/150] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:49 2022] GET /identity/v3/users/c91c516592a744e2a0e9153262700f78 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:49.564040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.654265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6faf48-d6f5-431f-9baf-b38b3b68314c None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.654596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6faf48-d6f5-431f-9baf-b38b3b68314c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.654843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6faf48-d6f5-431f-9baf-b38b3b68314c None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.656446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 70/151] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:49.670564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.670844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.671128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.710223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:49.710754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:49.711978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:49.733738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612bc8-50b7-4cfe-9b66-acb7701f58c6 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:49.806248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:49.806941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:49.807223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:49.807490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:49.812151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:49.813625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:49.815589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 82/152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:49 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:49.821416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:49.891375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 71/153] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:49.978873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.041628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f602987-fa31-48d2-9727-f1d855a13358 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:50.134974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:50.135649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:50.135939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:50.136762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/c91c516592a744e2a0e9153262700f78/roles/b5b4891f9d964c70b218a76d167f6a3c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:50.143861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea83b074d1446f9c350a5375eada88, user_id=c91c516592a744e2a0e9153262700f78, role_id=b5b4891f9d964c70b218a76d167f6a3c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:50.146008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:50.146130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.159057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c6070-29e4-4a18-98f2-b0ea9e2a5f96 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:50.202841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 83/154] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:49 2022] PUT /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88/users/c91c516592a744e2a0e9153262700f78/roles/b5b4891f9d964c70b218a76d167f6a3c => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:01:50.210247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.254725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.335081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:50.335739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:50.336027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:50.336791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:50.367021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:50.377449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:50.378423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:50.379201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:50.388863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 72/155] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:01:50.416604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.548150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dec73-b2f2-4cc5-bf17-e0bf7dc03f51 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:50.666568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:50.668195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:50.668691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:50.669167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:50.710348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:50.716656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:50.717478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:50.722605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:50.725857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 84/156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 522 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:50.726947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.832384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da119f-8ff5-40bd-98cf-8444d7edb659 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:50.927848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:50.946413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:50.947047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:50.947334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:50.947611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:50.948288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:50.949129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:50.950557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:50.969199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 73/157] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 553 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:50.970084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:50.994560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:51.008056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bad1a-ac3b-4bd6-9bad-93ea84e43834 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.105957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c20f2-6e24-44d6-b497-d3cdd9bef84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.106570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c20f2-6e24-44d6-b497-d3cdd9bef84c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.106861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c20f2-6e24-44d6-b497-d3cdd9bef84c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.107135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c20f2-6e24-44d6-b497-d3cdd9bef84c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.142788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c20f2-6e24-44d6-b497-d3cdd9bef84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-9c0c20f2-6e24-44d6-b497-d3cdd9bef84c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:51.147712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:51.148552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:51.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:51.158303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 85/158] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:01:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 431 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:51.159623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1552-c9db-40cd-b599-6fb3303e58b7 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.159918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1552-c9db-40cd-b599-6fb3303e58b7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.160210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcc1552-c9db-40cd-b599-6fb3303e58b7 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.162269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 86/159] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:51.162779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1552-c9db-40cd-b599-6fb3303e58b7 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.170433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005729-e0ab-468d-b69e-881eebef8b7c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.257935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.258729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.259018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.259295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.259981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:51.260293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.261985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:51.283590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 74/160] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:51.284275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.404729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcc1552-c9db-40cd-b599-6fb3303e58b7 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.442749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:51.492575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e4670c-a12e-4d12-a09e-ade185b4918f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.498424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc25254-2915-4a01-aa0a-5f16f664c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.499073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25254-2915-4a01-aa0a-5f16f664c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.499357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25254-2915-4a01-aa0a-5f16f664c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.499631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc25254-2915-4a01-aa0a-5f16f664c5e9 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.500815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25254-2915-4a01-aa0a-5f16f664c5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.502286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc25254-2915-4a01-aa0a-5f16f664c5e9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:51.504107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 87/161] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:51.504998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.505279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.505555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.526092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:51.542104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:51.543413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:51.546497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.547115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.547393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.547666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.548342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:51.548645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.550044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:51.576207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 75/162] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:51.577070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.705512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 88/163] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:51.706579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.780526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eed6ec-1c40-4c8e-817e-e2cf93e4e9da None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.850501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.851261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.851507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.851797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] PATH_INFO: `/v3/users/87f9b76a136e4875a30812fb5a16d50e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.854464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] RBAC: Authorizing `identity:get_user(user_id=87f9b76a136e4875a30812fb5a16d50e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:51.855989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:51.857609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 76/164] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/users/87f9b76a136e4875a30812fb5a16d50e => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:51.858424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:51.866021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:51.884048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fa296c-25da-4a05-b8cc-5b164c114103 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:51.952375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:51.952996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:51.953276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:51.953548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:51.957922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.041617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543fae4-e031-4354-a267-1d63b3a8e6e7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.077876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.081144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.114054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced0c62-28db-4a8c-97bb-edb9f6683867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.115105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced0c62-28db-4a8c-97bb-edb9f6683867 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.116970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced0c62-28db-4a8c-97bb-edb9f6683867 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.117674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced0c62-28db-4a8c-97bb-edb9f6683867 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.120164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced0c62-28db-4a8c-97bb-edb9f6683867 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.124836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced0c62-28db-4a8c-97bb-edb9f6683867 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.132098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 77/165] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:52.133322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8bd0-836e-4497-892b-5760de8375b7 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.133610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8bd0-836e-4497-892b-5760de8375b7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.133933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8bd0-836e-4497-892b-5760de8375b7 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.135309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 78/166] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:52.135910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d8bd0-836e-4497-892b-5760de8375b7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.219846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 89/167] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:52.221214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.260329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.290215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.338171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca517e8a-813d-48d4-9711-0a8b4289f982 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.346446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d8bd0-836e-4497-892b-5760de8375b7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.379892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614bd9a-45e7-4452-9148-332d619d2c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.382066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614bd9a-45e7-4452-9148-332d619d2c3d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.382596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614bd9a-45e7-4452-9148-332d619d2c3d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.383268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614bd9a-45e7-4452-9148-332d619d2c3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.402876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614bd9a-45e7-4452-9148-332d619d2c3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:52.408014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-8614bd9a-45e7-4452-9148-332d619d2c3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:52.408583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:52.409403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:52.410200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:52.410773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.410773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.410773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.412845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 90/168] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:52.415342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.415841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.416307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.439846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:52.441422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:52.498291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.500617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.523704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 91/169] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:52.525373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.566192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.619429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.653721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 79/170] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:52.654669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.671074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a05e61-6c49-4dc4-be8d-68d33e00b159 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.711107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec2092-3c32-4499-98a8-1743ab9d61e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.711756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec2092-3c32-4499-98a8-1743ab9d61e8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.711988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec2092-3c32-4499-98a8-1743ab9d61e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.712262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec2092-3c32-4499-98a8-1743ab9d61e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.783744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec2092-3c32-4499-98a8-1743ab9d61e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.785213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec2092-3c32-4499-98a8-1743ab9d61e8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.796696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324d46f-2d0f-4789-a190-37cc8ca481a4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:52.811499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.837952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088416-acb5-4aaa-832e-ac2b37812ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:52.838730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088416-acb5-4aaa-832e-ac2b37812ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.839053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088416-acb5-4aaa-832e-ac2b37812ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.839330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088416-acb5-4aaa-832e-ac2b37812ac0 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.840894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088416-acb5-4aaa-832e-ac2b37812ac0 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:52.842368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088416-acb5-4aaa-832e-ac2b37812ac0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:52.844006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 80/171] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:52.845116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcef549-56f4-4c78-9a08-a973e2dad845 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.845392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcef549-56f4-4c78-9a08-a973e2dad845 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.845660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcef549-56f4-4c78-9a08-a973e2dad845 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.849743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 81/172] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:52.849743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcef549-56f4-4c78-9a08-a973e2dad845 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.894860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:52.899417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 92/173] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:52.905078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0204e-982c-4915-aac9-2f43365d5493 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:52.905387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0204e-982c-4915-aac9-2f43365d5493 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:52.905694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0204e-982c-4915-aac9-2f43365d5493 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:52.907113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 93/174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:52.907688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0204e-982c-4915-aac9-2f43365d5493 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:52.969261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcef549-56f4-4c78-9a08-a973e2dad845 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.007316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.007955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.008239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.008514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.009180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:53.009483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.011430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.016436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0204e-982c-4915-aac9-2f43365d5493 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.025421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 82/175] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.025421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.043433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.055140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.055774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.056059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.056336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.057531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.059017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.060665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 94/176] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:52 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.061428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.145104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b943f2-7171-4915-8a82-89e178eec8a9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.146649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.164382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bbb00-a9c1-4a4b-ae4e-8f1baa9480d4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.180025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9995b1-fd66-4702-bab2-62c7efdc0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.180868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9995b1-fd66-4702-bab2-62c7efdc0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.181153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9995b1-fd66-4702-bab2-62c7efdc0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.181429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9995b1-fd66-4702-bab2-62c7efdc0cf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.191991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9995b1-fd66-4702-bab2-62c7efdc0cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:53.197475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-0e9995b1-fd66-4702-bab2-62c7efdc0cf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:53.197931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:53.199728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:53.200491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:53.201082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.201082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.201082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.201254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 83/177] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:53.201317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=29687ec14c104869a1721c16fabdef06) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:53.201317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.201434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373e0a-a55d-40be-b358-c5bf1ffafc61 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.201434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373e0a-a55d-40be-b358-c5bf1ffafc61 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.201434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c373e0a-a55d-40be-b358-c5bf1ffafc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.201603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.207879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 95/178] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/role_assignments?user.id=29687ec14c104869a1721c16fabdef06&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.209020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.220812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8c373e0a-a55d-40be-b358-c5bf1ffafc61 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:53.222181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8c373e0a-a55d-40be-b358-c5bf1ffafc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:53.276315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.301807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 84/179] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:53.302915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.303210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.303485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.325288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:53.326540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:53.338749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a12f1b-e33b-453e-99bd-7bf077298145 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.383590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.384278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.384565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.384845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.387038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.389297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.391171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 96/180] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.391852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.412499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 85/181] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:53.413630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.443791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.519063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a76a0-8886-447d-b7ed-06cc14d66893 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.546516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c40b54b-8ce9-424a-81ee-795f86494d14 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.547029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.562273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbf8d6-4bd9-4f90-a839-bb998f8407f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.563385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbf8d6-4bd9-4f90-a839-bb998f8407f0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.564276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbf8d6-4bd9-4f90-a839-bb998f8407f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.564768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbf8d6-4bd9-4f90-a839-bb998f8407f0 None admin] PATH_INFO: `/v3/users/29687ec14c104869a1721c16fabdef06` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.566381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbf8d6-4bd9-4f90-a839-bb998f8407f0 None admin] RBAC: Authorizing `identity:get_user(user_id=29687ec14c104869a1721c16fabdef06)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.568514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbf8d6-4bd9-4f90-a839-bb998f8407f0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.570449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 97/182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/users/29687ec14c104869a1721c16fabdef06 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.571789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c6f3-6974-49bf-810b-545a3335163b None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.572303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c6f3-6974-49bf-810b-545a3335163b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.572783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6c6f3-6974-49bf-810b-545a3335163b None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.575304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 98/183] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:53.576763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c6f3-6974-49bf-810b-545a3335163b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.594961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.595577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.595863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.596139 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.596970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=87f9b76a136e4875a30812fb5a16d50e) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:53.597238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.598715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.605895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 86/184] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/role_assignments?user.id=87f9b76a136e4875a30812fb5a16d50e&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.606994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.709085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.719339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6c6f3-6974-49bf-810b-545a3335163b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.728648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b3761-3238-45ce-b936-6cda92aaa759 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.758566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.759193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.759717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.759717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.760420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:53.760727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.762405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9157394b-a5e4-4967-a48a-87025761bc01 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.771027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.771645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.771923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.777217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.777392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 99/185] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.777469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] RBAC: Adding query filter params (role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=29687ec14c104869a1721c16fabdef06) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:53.777469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:53.777653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.777653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.777653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:53.777877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:53.783306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 87/186] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/role_assignments?user.id=29687ec14c104869a1721c16fabdef06&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=ca37184ac9034a398797d8994e2ce144 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:53.784148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.798282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:53.799699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:53.872296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:53.899047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 100/187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:53.900288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:53.925307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c32fb38-d096-4907-8268-57908364e05c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:53.976405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:53.977370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:53.977912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:53.978411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.010934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.035823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c1ca3-f5f1-4492-be98-208168991b7c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.076678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.078242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.089252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.090758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.091316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.092148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.107398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:54.114707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:54.115570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:54.116428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:54.119019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 101/188] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:54.119639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.172273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.193254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 88/189] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:54.194228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.229172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cce2f04-707c-4977-acd9-80fe6493ebb4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.243866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.265030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.265654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.265957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.266228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.267333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.268784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.270399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 102/190] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:54.271160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.294422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5244268-e8e3-4e07-b99b-23e24da720db None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.327828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.328664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.328948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.329223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] PATH_INFO: `/v3/users/292c488414324fdb956a9777aa37fba4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.342584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] RBAC: Authorizing `identity:get_user(user_id=292c488414324fdb956a9777aa37fba4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.344053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.345846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 89/191] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/users/292c488414324fdb956a9777aa37fba4 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:54.346461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.374031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1851b-0774-46cb-b2bb-d6cb0dcaaedf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.386979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.408435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.409034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.409319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.409594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.410310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:54.410612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.411965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.420472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 103/192] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:54.425178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.444019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d87696-5eab-4ed5-860a-cf80e53cb348 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.453183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.478757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.479383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.480367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.480653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.490493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:54.495309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:54.496219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:54.496969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 90/193] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:54.497605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.524909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7517eb9-6bfb-4c4a-aa6f-1e429c29c623 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.558734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.559359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.559642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.559914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] PATH_INFO: `/v3/projects/ec0e45d8deb94cc694a3aef58750d58e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.561040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] RBAC: Authorizing `identity:get_project(project_id=ec0e45d8deb94cc694a3aef58750d58e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.562509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.564143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 104/194] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/projects/ec0e45d8deb94cc694a3aef58750d58e => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:54.564903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.598374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d5280-7b91-4f75-aac5-534b2eeede65 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.609836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.632706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.633310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.633586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.633895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.634543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.636946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.658207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 91/195] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:01:54 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:54.659033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.673347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed5382-e16b-42a8-a8a3-67d496a89310 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.688001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.713041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.713674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.714801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.715124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.776954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f10d2-cafb-46a8-b7f3-af3781b2fe73 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.801430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.803621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.814443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.815080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.815361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.815636 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] PATH_INFO: `/v3/users/292c488414324fdb956a9777aa37fba4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.816859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] RBAC: Authorizing `identity:get_user(user_id=292c488414324fdb956a9777aa37fba4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.818382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:54.819999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 92/196] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/users/292c488414324fdb956a9777aa37fba4 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:54.820772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.862352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.936213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:54.941158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 105/197] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:54.942203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:54.950759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608d353-c81b-4c09-b6f8-68f5010b24e0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:54.991609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:54.992225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:54.992508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:54.992783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:54.993460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:54.993796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:54.995823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.006233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 93/198] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:55.007326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.061913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00447ec9-5427-4377-b07f-b18728ad12cb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.101421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.102504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.102984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.103453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.104471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=ec0e45d8deb94cc694a3aef58750d58e, user.id=29687ec14c104869a1721c16fabdef06) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:55.104998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.106744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.113841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 106/199] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:54 2022] GET /identity/v3/role_assignments?user.id=29687ec14c104869a1721c16fabdef06&scope.project.id=ec0e45d8deb94cc694a3aef58750d58e&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:55.115029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.131844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.144596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74215-6d6a-4cef-9dcb-6ab9f02b93b0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.251204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e60d3-6907-44fa-aeb9-942afb60dd5c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.258574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.259542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.259542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.259542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.301902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.302820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.303250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.303680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.305603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.308206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.309673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.312271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 107/200] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:55.313214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.380040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.382317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.432100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.461972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae7371-2aa6-42da-b684-cfd646e6d88c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.498464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 94/201] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:55.499598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.503033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.503938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.504436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.504909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] PATH_INFO: `/v3/users/c91c516592a744e2a0e9153262700f78` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.506573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] RBAC: Authorizing `identity:get_user(user_id=c91c516592a744e2a0e9153262700f78)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.508335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.510493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 108/202] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/users/c91c516592a744e2a0e9153262700f78 => generated 289 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:55.511777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.563029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.627500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a72c6-5162-42dd-8bd0-c625727fd958 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.642902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a05f2-47d5-4835-9704-6fe6227cb42d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.665801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.666412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.666693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.667618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.668364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=292c488414324fdb956a9777aa37fba4) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:55.668676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.670145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.676137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 95/203] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/role_assignments?user.id=292c488414324fdb956a9777aa37fba4&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:55.676773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.692312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.693050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.693336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.693616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.694923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.696714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.698439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 109/204] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:55.706823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:55.731880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.804994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee41ce-184b-4b6b-b010-5e5d712d8e07 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.828724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:55.866820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.867821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.868111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.868391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.930354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbadf6b-6c7a-4235-a11c-50d74797b263 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:55.962983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:55.963608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:55.964435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:55.964715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:55.965600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] RBAC: Adding query filter params (role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=292c488414324fdb956a9777aa37fba4) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:55.965964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:55.967620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:55.974445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 110/205] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/role_assignments?user.id=292c488414324fdb956a9777aa37fba4&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=ca37184ac9034a398797d8994e2ce144 => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:56.075435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:56.076881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:56.213119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 96/206] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:01:56.219192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:56.298740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:56.324644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e5849-5a96-4590-994f-e2e4cd005807 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:56.361063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6cf463-7a10-4b3c-8cb0-2b74a789f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:56.361623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf463-7a10-4b3c-8cb0-2b74a789f79d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.361933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf463-7a10-4b3c-8cb0-2b74a789f79d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.362206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6cf463-7a10-4b3c-8cb0-2b74a789f79d None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.363353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cf463-7a10-4b3c-8cb0-2b74a789f79d None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:56.364837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6cf463-7a10-4b3c-8cb0-2b74a789f79d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:56.366589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 111/207] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:56 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:56.374779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:56.395305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:56.509960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189249be-2944-4618-8fbd-7b6719825515 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:56.561100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:56.561723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.562025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.562297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.563030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] RBAC: Adding query filter params (role.id=b5b4891f9d964c70b218a76d167f6a3c, scope.project.id=a8ea83b074d1446f9c350a5375eada88, user.id=c91c516592a744e2a0e9153262700f78) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:56.563340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:56.564798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3a18f7-3534-494c-8586-bc53c9122289 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:56.575023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 97/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:56 2022] GET /identity/v3/role_assignments?user.id=c91c516592a744e2a0e9153262700f78&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=b5b4891f9d964c70b218a76d167f6a3c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:56.957781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4429-1e52-4de0-a643-fe7f03dc0e2f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.958305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4429-1e52-4de0-a643-fe7f03dc0e2f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.958305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a4429-1e52-4de0-a643-fe7f03dc0e2f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.959674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 112/209] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:56.965882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384edbaf-a003-4c12-82f3-12fad95e2b06 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:56.966167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384edbaf-a003-4c12-82f3-12fad95e2b06 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:56.966441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384edbaf-a003-4c12-82f3-12fad95e2b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:56.985100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-384edbaf-a003-4c12-82f3-12fad95e2b06 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:56.986340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-384edbaf-a003-4c12-82f3-12fad95e2b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:57.065018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 98/210] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:57.313250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2d59-a821-400b-b8f3-6eb32c4a3557 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.313937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2d59-a821-400b-b8f3-6eb32c4a3557 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.314424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf2d59-a821-400b-b8f3-6eb32c4a3557 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.316260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 113/211] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:57.321538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.322409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.322881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.342314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:57.343802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:57.351622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:57.363424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2d59-a821-400b-b8f3-6eb32c4a3557 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.418700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 99/212] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:01:57.483346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bf2d59-a821-400b-b8f3-6eb32c4a3557 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.519181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.519809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.520088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.520357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.531282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:57.536447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:57.537296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:57.538121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 114/213] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:01:57.543575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.651676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ad344-8a49-4083-b73d-d90533f50c15 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.686445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.687059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.687345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.687635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.688290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:57.688594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.690131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:57.699191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 100/214] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:57.704867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.710245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:57.722558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.726365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:57.840512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a9442-8f09-4dfd-b5c3-bc70c8270368 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.848067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1fc6-c5a3-4a56-be45-05b94642159e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:57.886529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.887160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.887484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.887753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] PATH_INFO: `/v3/users/624372beb8ae49df81421f5767efb05b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.893933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:57.894571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:57.894861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:57.895133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:57.896673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.898429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:57.900912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 101/215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:57.906224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.906681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] RBAC: Authorizing `identity:get_user(user_id=624372beb8ae49df81421f5767efb05b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:57.908253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:57.914891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 115/216] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/users/624372beb8ae49df81421f5767efb05b => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:57.916253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:57.986033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:57.993004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.030980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50bb811-7a41-4629-b20d-3138be4c5948 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.031809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b863cc44-1d62-4667-8558-d1f5150d9ec6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.066997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.067613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.067952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.068232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.073607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11a469-0bee-4c9c-a9cc-9b5ef9f68763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.074613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11a469-0bee-4c9c-a9cc-9b5ef9f68763 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.075083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11a469-0bee-4c9c-a9cc-9b5ef9f68763 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.075524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11a469-0bee-4c9c-a9cc-9b5ef9f68763 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.076361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11a469-0bee-4c9c-a9cc-9b5ef9f68763 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.077997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11a469-0bee-4c9c-a9cc-9b5ef9f68763 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.100474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 102/217] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:01:57 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:01:58.106096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6647-b4a0-4844-8362-3c61648ef7bd None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.106096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6647-b4a0-4844-8362-3c61648ef7bd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.106096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a6647-b4a0-4844-8362-3c61648ef7bd None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.109816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 103/218] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:58.109816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975836cf-c00c-43f6-890b-1c7933304f29 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.109816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975836cf-c00c-43f6-890b-1c7933304f29 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.110119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975836cf-c00c-43f6-890b-1c7933304f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.130303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-975836cf-c00c-43f6-890b-1c7933304f29 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:58.131815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-975836cf-c00c-43f6-890b-1c7933304f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:58.156369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.158187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.210230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 104/219] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:58.217037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49d5f-0cb8-448b-8a18-5275b3620f88 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.217594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49d5f-0cb8-448b-8a18-5275b3620f88 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.217925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49d5f-0cb8-448b-8a18-5275b3620f88 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.219552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 105/220] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:01:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:01:58.225224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.225516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.225827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.238131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.245638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:01:58.246956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:01:58.289737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 116/221] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:01:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:01:58.295476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.316670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.342055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 106/222] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:01:58.408759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be669-512f-4d0c-9fc4-49efae4fe6a5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.449991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.450908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.451380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.451864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.453588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.455297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.461646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 117/223] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:58.465760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.491100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.528827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.605049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027eb9c-f047-436d-9273-2c9e1d7badd1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.625270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5005d-79ab-4eb8-8a92-8ec79c4c436e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.642585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.643204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.643487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.643764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.644502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=624372beb8ae49df81421f5767efb05b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:58.644810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.646309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.652221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 107/224] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/role_assignments?user.id=624372beb8ae49df81421f5767efb05b&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:58.656827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.670364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.670868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.671146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.671418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.683948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:58.688940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:58.689865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:01:58.690643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 118/225] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:58.700259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.741007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.811218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:58.813736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed3b86-ab8a-43cd-8fbc-e0d3d8413066 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.830252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12abbd-8f83-4550-afcd-dc8f5e9bde10 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:58.865304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.866202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.866574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.867001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.869565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:58.870996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:58.871491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:58.871969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:58.872918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:58.873428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:58.875143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:58.881152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:01:58.887330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 119/226] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:01:58.888267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:01:58.889080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:01:58.889905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:01:58.894161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 108/227] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:01:58.895232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:58.900830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.022559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3b69c-03aa-4f59-8cd6-30ddaa655b5f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.037869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.062967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.064078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.064563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.065047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.066008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:01:59.067334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.068950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.078612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 109/228] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:59.086342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.139114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea41f0b-8b0e-4a2b-9f0b-b894281ba034 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.201894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8711ec3-ed00-4ee6-b271-3fd621f47d85 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.217056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e059e7a-a177-401c-9942-163685043318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.217693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e059e7a-a177-401c-9942-163685043318 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.218006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e059e7a-a177-401c-9942-163685043318 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.218437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e059e7a-a177-401c-9942-163685043318 None admin] PATH_INFO: `/v3/users/292c488414324fdb956a9777aa37fba4` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.219711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e059e7a-a177-401c-9942-163685043318 None admin] RBAC: Authorizing `identity:get_user(user_id=292c488414324fdb956a9777aa37fba4)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.221439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e059e7a-a177-401c-9942-163685043318 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.223166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 120/229] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:58 2022] GET /identity/v3/users/292c488414324fdb956a9777aa37fba4 => generated 283 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:59.231871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e059e7a-a177-401c-9942-163685043318 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.256755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.257802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.259143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.259623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] PATH_INFO: `/v3/users/292c488414324fdb956a9777aa37fba4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.262316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] RBAC: Authorizing `identity:get_user(user_id=292c488414324fdb956a9777aa37fba4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.264830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.268936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 110/230] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/users/292c488414324fdb956a9777aa37fba4 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:01:59.286143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.287505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.367537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.399351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e059e7a-a177-401c-9942-163685043318 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.464044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.467062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.467356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.467639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.469076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.470570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.472385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 121/231] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:59.480456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.508899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f4059-40fb-41d3-8591-efafc7b54415 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.581627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.582291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.582571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.582842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.584088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.586986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.595955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 111/232] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:01:59 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:01:59.607235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:01:59.611075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.628060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24a419-f7b5-42c3-9beb-a4f94dc1e998 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.666625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f582fb73-ba0b-4432-8938-e76ca49d7056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.667835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fb73-ba0b-4432-8938-e76ca49d7056 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.668120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fb73-ba0b-4432-8938-e76ca49d7056 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.668401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f582fb73-ba0b-4432-8938-e76ca49d7056 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/292c488414324fdb956a9777aa37fba4/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.674492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fb73-ba0b-4432-8938-e76ca49d7056 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d16856fa59d4597a4bd455b9b99c9d7, user_id=292c488414324fdb956a9777aa37fba4, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.676009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f582fb73-ba0b-4432-8938-e76ca49d7056 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.703139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 122/233] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:59 2022] PUT /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/292c488414324fdb956a9777aa37fba4/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:01:59.753189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3de0-04e7-44b2-a345-92d78e21c333 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:01:59.767319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:01:59.809661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10449ac5-b812-44c4-8167-626962667a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:01:59.810378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449ac5-b812-44c4-8167-626962667a3d None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:01:59.810661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449ac5-b812-44c4-8167-626962667a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:01:59.810934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10449ac5-b812-44c4-8167-626962667a3d None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/292c488414324fdb956a9777aa37fba4/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:01:59.815552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449ac5-b812-44c4-8167-626962667a3d None admin] RBAC: Authorizing `identity:create_grant(project_id=6d16856fa59d4597a4bd455b9b99c9d7, user_id=292c488414324fdb956a9777aa37fba4, role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:01:59.817053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10449ac5-b812-44c4-8167-626962667a3d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:01:59.838147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 112/234] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:01:59 2022] PUT /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/292c488414324fdb956a9777aa37fba4/roles/ca37184ac9034a398797d8994e2ce144 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:00.669179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3651857-0987-47b2-b8a9-d0bf68050de9 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.669695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3651857-0987-47b2-b8a9-d0bf68050de9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.669822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3651857-0987-47b2-b8a9-d0bf68050de9 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.671356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 123/235] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:00.677163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd9c0c-4214-46bd-b96e-31a49730684a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.678022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd9c0c-4214-46bd-b96e-31a49730684a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.678565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd9c0c-4214-46bd-b96e-31a49730684a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.698571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-68dd9c0c-4214-46bd-b96e-31a49730684a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:00.700132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-68dd9c0c-4214-46bd-b96e-31a49730684a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:00.732327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522b09-00ba-44de-8165-ee5a77998caa None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.732626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522b09-00ba-44de-8165-ee5a77998caa None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.732893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522b09-00ba-44de-8165-ee5a77998caa None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.734526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 124/236] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:00.739568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c5cf-2fef-47a8-8471-02e9efae0a97 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:00.739839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c5cf-2fef-47a8-8471-02e9efae0a97 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:00.740126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863c5cf-2fef-47a8-8471-02e9efae0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:00.762708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6863c5cf-2fef-47a8-8471-02e9efae0a97 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:00.764169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6863c5cf-2fef-47a8-8471-02e9efae0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:00.777565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 113/237] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:00.864318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 125/238] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:01.061386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992571-526f-4b5f-b43c-9aacc853c29d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.061748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992571-526f-4b5f-b43c-9aacc853c29d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.061974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec992571-526f-4b5f-b43c-9aacc853c29d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.063646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 114/239] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:01.072591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.073018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.073298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.092520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:01.093738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:01.161289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec992571-526f-4b5f-b43c-9aacc853c29d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.186803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 126/240] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:01.241668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.253298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.341818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.346830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec992571-526f-4b5f-b43c-9aacc853c29d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.396430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.397245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.397628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.398040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.399278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.401521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.403848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 115/241] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:01.409025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.409664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85ad08b-eda6-4803-92c6-d42b07762c0b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.517612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.518208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.518494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.520637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.532981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7596a-2f60-4de2-b8f1-eab416981cd8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.536026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:01.540917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:01.542405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:01.544000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 127/242] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:01.545373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.578670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.579447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.579980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.580354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.581571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.583460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.612051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 116/243] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:01 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:01.613525 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.628749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.649977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.676199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ecf7e8-e64e-47aa-ba36-30e806f43852 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.720445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.721102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.721388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.721664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.735791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:01.741106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:01.741990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:01.742797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 128/244] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:01.750602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.765880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b404e987-be1a-434a-948e-db5f1e28e132 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.810340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.811149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.811693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.812072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.813048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:01.813462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.815084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.824977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 117/245] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:01.830761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.876655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300e7cb9-b766-4144-bb4a-f3f8b075aed9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:01.911143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.935160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:01.936117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:01.936603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:01.937140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:01.938175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:01.938685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:01.940399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:01.941104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:01.953611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 129/246] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:01.959275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:01.966259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941597f2-e49c-4b65-bd1e-3db3f19db814 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.009040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.010965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.012389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.012978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] PATH_INFO: `/v3/users/2580c92e1a72404e83bf2a400fb2b065` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.032190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] RBAC: Authorizing `identity:get_user(user_id=2580c92e1a72404e83bf2a400fb2b065)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.034564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.037036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 118/247] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/users/2580c92e1a72404e83bf2a400fb2b065 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:02.044077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.096248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9eca6-0f73-4981-97e5-4e9e203c9894 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.145534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db71f-e944-4b06-b4cd-fea2f239922f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.146230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db71f-e944-4b06-b4cd-fea2f239922f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.146514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db71f-e944-4b06-b4cd-fea2f239922f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.146790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db71f-e944-4b06-b4cd-fea2f239922f None admin] PATH_INFO: `/v3/users/624372beb8ae49df81421f5767efb05b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.148328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db71f-e944-4b06-b4cd-fea2f239922f None admin] RBAC: Authorizing `identity:get_user(user_id=624372beb8ae49df81421f5767efb05b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.149824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db71f-e944-4b06-b4cd-fea2f239922f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.152164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 130/248] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:01 2022] GET /identity/v3/users/624372beb8ae49df81421f5767efb05b => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:02.153160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ff4a-4b22-46b4-82bb-ef76784f0940 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.153448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ff4a-4b22-46b4-82bb-ef76784f0940 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.153741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c9ff4a-4b22-46b4-82bb-ef76784f0940 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.159145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 131/249] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:02.160550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9ff4a-4b22-46b4-82bb-ef76784f0940 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.188640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41720a61-8412-4b97-8538-53a03de7a75d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.236422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.237753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.237753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.237753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.240684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:02.254333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:02.302270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c9ff4a-4b22-46b4-82bb-ef76784f0940 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.318231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.319724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.342245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbc024-dc3c-42e2-b313-6a4e7e4936f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.342887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc024-dc3c-42e2-b313-6a4e7e4936f2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.343176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc024-dc3c-42e2-b313-6a4e7e4936f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.343452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbc024-dc3c-42e2-b313-6a4e7e4936f2 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.345136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc024-dc3c-42e2-b313-6a4e7e4936f2 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.346915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbc024-dc3c-42e2-b313-6a4e7e4936f2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.349799 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 132/250] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:02.351615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.353853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.354277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.382311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:02.383897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:02.482927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 119/251] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:02.483775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.515135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 133/252] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:02.515994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.550425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:02.610875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7401274-1cc2-43b7-b677-c53ab72663a9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.628474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:02.649480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca36035f-07f1-4f95-bf29-fcee810146b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.650187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36035f-07f1-4f95-bf29-fcee810146b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.650471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36035f-07f1-4f95-bf29-fcee810146b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.650799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca36035f-07f1-4f95-bf29-fcee810146b3 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/624372beb8ae49df81421f5767efb05b/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.652748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36035f-07f1-4f95-bf29-fcee810146b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d16856fa59d4597a4bd455b9b99c9d7, user_id=624372beb8ae49df81421f5767efb05b, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.654233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca36035f-07f1-4f95-bf29-fcee810146b3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.670618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 120/253] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:02 2022] PUT /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/624372beb8ae49df81421f5767efb05b/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:02.678054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d2ae-4b43-4933-a46c-465621f1a1d4 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.678346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d2ae-4b43-4933-a46c-465621f1a1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.678613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826d2ae-4b43-4933-a46c-465621f1a1d4 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.680368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 121/254] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:02.686472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.686741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.687033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.714804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:02.716018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:02.746795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6ea915-d34b-4823-aa92-d175115f265f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:02.824132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:02.824872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:02.825161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:02.825438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:02.826930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:02.828458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:02.833239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 134/255] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:02.837527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.860445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 122/256] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:02.922912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:02.988756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c110b2-5a94-4e69-8f37-1e3adae14c98 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.015547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.031634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.058182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.058803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.059087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.059364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.060108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] RBAC: Adding query filter params (role.id=b5b4891f9d964c70b218a76d167f6a3c, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=2580c92e1a72404e83bf2a400fb2b065) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:03.060411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.062008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.069283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 135/257] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/role_assignments?user.id=2580c92e1a72404e83bf2a400fb2b065&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=b5b4891f9d964c70b218a76d167f6a3c => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:03.143695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a67d3-5b2b-4397-a10e-5baf87104695 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.173822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.191673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.192328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.192605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.192874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.218132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:03.223276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:03.224132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:03.224905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 123/258] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:03.230634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.359108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902cd26-ec20-48c1-8285-66a16a223a27 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.410062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.427613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d777fd-de54-4988-a018-5098f41cf055 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.443123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.443805 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.444081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.444359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.460887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:03.467028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:03.467885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:03.468656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 136/259] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:03.479936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.543376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.543998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.544278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.544548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.545225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:03.545531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.546942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.555073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.565898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 124/260] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:03.590801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.626214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c8526-e656-4417-8521-6ff8482cc1b7 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.662323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.662942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.663234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.663598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.664298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:03.664604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.666010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.675641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 137/261] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:03.681637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.814942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abceeaa8-76fe-447f-9e2c-d2f0742ff312 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.883920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11fe78c-0be9-4434-ad94-f8327d686be4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:03.886548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.887197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.887482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.887759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] PATH_INFO: `/v3/users/292c488414324fdb956a9777aa37fba4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.888958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] RBAC: Authorizing `identity:get_user(user_id=292c488414324fdb956a9777aa37fba4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.895125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.896765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 125/262] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/users/292c488414324fdb956a9777aa37fba4 => generated 283 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:03.901535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.904011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:03.950547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:03.980442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:03.981090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:03.981370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:03.981643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] PATH_INFO: `/v3/users/292c488414324fdb956a9777aa37fba4` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:03.986451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] RBAC: Authorizing `identity:get_user(user_id=292c488414324fdb956a9777aa37fba4)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:03.987967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:03.989973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 138/263] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/users/292c488414324fdb956a9777aa37fba4 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:03.995694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.081290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a801c2d-2841-4517-ac92-17d6bfaa5990 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.141056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.141977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.142266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.142952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.273250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.275109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.287860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14ecbd-2313-4e05-8851-cf87156a1a36 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.328131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:04.362482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d061591-eb58-4a3c-9f33-1e08369eb2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.363100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061591-eb58-4a3c-9f33-1e08369eb2f4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.363383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061591-eb58-4a3c-9f33-1e08369eb2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.363653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d061591-eb58-4a3c-9f33-1e08369eb2f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.438000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:04.473515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 126/264] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:04.475682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061591-eb58-4a3c-9f33-1e08369eb2f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.477148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d061591-eb58-4a3c-9f33-1e08369eb2f4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.479701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.626429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd2c4dc-3961-4858-9da8-6aa9e56f7a76 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.666269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:04.677331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.678005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.678284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.678554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.679680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.681198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.687812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 127/265] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:04 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:04.688642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.760305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 139/266] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 765 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:04.761613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be8b7-4642-4938-8e31-a561c0dd2c93 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.761945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be8b7-4642-4938-8e31-a561c0dd2c93 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.762223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185be8b7-4642-4938-8e31-a561c0dd2c93 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.763732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 140/267] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:04.768767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012568f-9a2e-40b4-83f3-b58f1458d698 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.769056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012568f-9a2e-40b4-83f3-b58f1458d698 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.769334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012568f-9a2e-40b4-83f3-b58f1458d698 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.770770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 141/268] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:04.771338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012568f-9a2e-40b4-83f3-b58f1458d698 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:04.800865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11277a37-d43e-474d-97f7-620d24f87f50 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.841561 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:04.842397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.843008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.843586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.844832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=292c488414324fdb956a9777aa37fba4) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:04.845456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:04.847582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e0a221-687f-4b33-930d-c2eb4c85d6c6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:04.856461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 128/269] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:04 2022] GET /identity/v3/role_assignments?user.id=292c488414324fdb956a9777aa37fba4&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:04.857842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4095f8-1ef0-4d2a-bce7-6428459e2fd6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.858283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4095f8-1ef0-4d2a-bce7-6428459e2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.858727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4095f8-1ef0-4d2a-bce7-6428459e2fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:04.889398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:04.893587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-af4095f8-1ef0-4d2a-bce7-6428459e2fd6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:04.894839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-af4095f8-1ef0-4d2a-bce7-6428459e2fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:04.950507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012568f-9a2e-40b4-83f3-b58f1458d698 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:04.956983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:04.978597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 129/270] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:04.980697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:04.980981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:04.981266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.010411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.011387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.011675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.011952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.014693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.016163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.017887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 142/271] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:04 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:05.025449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.034329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:05.035537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:05.122082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 130/272] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:05.154648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600e74-8978-499c-a7bd-11b38331c6ed None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.191516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.192514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.192991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.193457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.194477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] RBAC: Adding query filter params (role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=292c488414324fdb956a9777aa37fba4) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:05.194981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.196686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.204161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 143/273] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/role_assignments?user.id=292c488414324fdb956a9777aa37fba4&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=ca37184ac9034a398797d8994e2ce144 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:05.357432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.481209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467a12-c48f-46ba-897b-ba49ae2d0fab None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.500495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.512246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.525154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.526100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.526234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.526638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.527101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.539158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:05.544412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:05.545476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:05.546482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:05.548704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 131/274] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:05.554159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.638797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c749a-45f1-49eb-806c-30b8bfdbba62 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.663568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793cc16-5af1-4a3e-9f15-bf482d37ba95 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.677085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.678112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.678383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.678781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.680010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.681758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.684066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 144/275] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:05.689459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.703967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.705291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.705774 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.706190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.707002 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:05.707458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.709100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.719436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 132/276] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:05.725257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:05.769638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.781676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:05.809547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda442b-cd2f-42f7-89c7-f2aeaa4262d7 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.838940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a1cfc7-59eb-49cc-b94d-fbdd28ea3d33 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:05.843854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0fa52-8ccc-40a9-86d4-2f664d8fab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.844460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0fa52-8ccc-40a9-86d4-2f664d8fab7c None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.844743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0fa52-8ccc-40a9-86d4-2f664d8fab7c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.845019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0fa52-8ccc-40a9-86d4-2f664d8fab7c None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.845685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0fa52-8ccc-40a9-86d4-2f664d8fab7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.847147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0fa52-8ccc-40a9-86d4-2f664d8fab7c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 145/277] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abb845-1c11-4d1d-9d5a-03e09f51d02b None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abb845-1c11-4d1d-9d5a-03e09f51d02b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abb845-1c11-4d1d-9d5a-03e09f51d02b None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 146/278] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91170c14-9793-40e6-9ec2-3c534cd0630d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.867781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91170c14-9793-40e6-9ec2-3c534cd0630d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.878375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91170c14-9793-40e6-9ec2-3c534cd0630d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.878375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 147/279] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:05.879149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.879441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.879766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.884300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66543638-433d-4931-9bdc-ee582018e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:05.885493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543638-433d-4931-9bdc-ee582018e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.885808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543638-433d-4931-9bdc-ee582018e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.886092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66543638-433d-4931-9bdc-ee582018e3f4 None admin] PATH_INFO: `/v3/users/10e7f367cb694146a5b6d5ba520a75e0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.900121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:05.901963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:05.902524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543638-433d-4931-9bdc-ee582018e3f4 None admin] RBAC: Authorizing `identity:get_user(user_id=10e7f367cb694146a5b6d5ba520a75e0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:05.904020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66543638-433d-4931-9bdc-ee582018e3f4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:05.905755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 133/280] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/users/10e7f367cb694146a5b6d5ba520a75e0 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:05.909919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:05.909919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:05.909919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:05.930441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:05.930441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:05.985384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 148/281] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:05.986635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.042226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 134/282] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:06.074989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.118025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2060b-a4fd-4e06-a136-1af569528b89 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.154727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.155558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.155981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.156478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.157344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, user.id=10e7f367cb694146a5b6d5ba520a75e0, scope.system=all) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:06.157822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.159412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:06.164878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 149/283] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 00:02:05 2022] GET /identity/v3/role_assignments?user.id=10e7f367cb694146a5b6d5ba520a75e0&scope.system=all&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:06.268613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.299473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.314590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.393068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88302b6e-16f1-4202-a3e5-a1a49405d251 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.435266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.435912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.436197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.436312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d89e7-a984-4e2f-acc4-2018cfc29d1d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.436471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.449664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:06.455659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:06.456520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:06.457283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 135/284] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:06.479439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.482613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.483360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.483703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.483975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.490142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.508535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:06.517246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:06.519379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:06.521306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 150/285] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:06.524816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.643012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.662185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d801f5-f05f-4e11-9ab9-0ffa27c14c41 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.721062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57f419-e46d-458f-9f36-8a276ae10f04 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.730149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.730772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.731055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.731328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.732121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:06.732432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.733955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:06.749922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 136/286] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:06.755531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.760742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.761361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.761641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.761951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.762625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:06.762996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.764311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:06.773261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 151/287] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:06.778736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.858491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:06.880548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e30fe7-d06c-4d45-97b3-740a5522499d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.921425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4a37f-6210-43ba-bf9e-c60f8d660a2a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:06.962611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:06.966070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:06.966792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:06.968294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] PATH_INFO: `/v3/users/624372beb8ae49df81421f5767efb05b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:06.969762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] RBAC: Authorizing `identity:get_user(user_id=624372beb8ae49df81421f5767efb05b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:06.971410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:06.973510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 137/288] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/users/624372beb8ae49df81421f5767efb05b => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:06.979462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:06.999287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.000232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.000711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.001182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] PATH_INFO: `/v3/users/2580c92e1a72404e83bf2a400fb2b065` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.002682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] RBAC: Authorizing `identity:get_user(user_id=2580c92e1a72404e83bf2a400fb2b065)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.004331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.007713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 152/289] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/users/2580c92e1a72404e83bf2a400fb2b065 => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:07.013717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:07.019432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:07.126970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74994a8f-f423-4ef0-a4de-176a978cc2ab None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:07.143924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:07.171965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.172514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.172793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.173067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.174848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.176295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.177970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 153/290] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:07 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:07.195413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:07.222751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb97938-315b-424f-8894-2acf0437db7e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:07.316988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.317615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.317923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.318199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.361981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa05a1a8-cfe8-4881-8d64-7935ec17e57f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:07.418758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.419409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.419700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.419975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/2580c92e1a72404e83bf2a400fb2b065/roles/b5b4891f9d964c70b218a76d167f6a3c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.422095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d16856fa59d4597a4bd455b9b99c9d7, user_id=2580c92e1a72404e83bf2a400fb2b065, role_id=b5b4891f9d964c70b218a76d167f6a3c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.423550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.445532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 154/291] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:07 2022] PUT /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/users/2580c92e1a72404e83bf2a400fb2b065/roles/b5b4891f9d964c70b218a76d167f6a3c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:07.460423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.462032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.486431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:07.593331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 138/292] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:07.599308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:07.663585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:07.725176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33266056-6b3f-4450-a477-7f982f21c8d3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:07.762225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab9981-742f-4446-b50b-2e90bc2ccb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.762859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9981-742f-4446-b50b-2e90bc2ccb3c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.763144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9981-742f-4446-b50b-2e90bc2ccb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.763418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab9981-742f-4446-b50b-2e90bc2ccb3c None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.764564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9981-742f-4446-b50b-2e90bc2ccb3c None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.766026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab9981-742f-4446-b50b-2e90bc2ccb3c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.767969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 155/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:07 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:07.773972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:07.894720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16507968-197a-4ffb-abbc-e52bb6ffa53d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:07.920381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:07.954120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:07.954743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:07.955023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:07.955348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:07.956092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=624372beb8ae49df81421f5767efb05b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:07.956451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:07.957998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b1580-2636-47dd-939a-f31981ce1fb3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:07.967622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 139/294] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:07 2022] GET /identity/v3/role_assignments?user.id=624372beb8ae49df81421f5767efb05b&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:08.324860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664572-48b4-49f1-b520-1d88b422e9d7 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.325369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664572-48b4-49f1-b520-1d88b422e9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.325442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb664572-48b4-49f1-b520-1d88b422e9d7 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.327156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 156/295] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:08.339558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813c97-cf37-4b1e-b9f2-c33be1b69c84 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.339848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813c97-cf37-4b1e-b9f2-c33be1b69c84 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.340132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813c97-cf37-4b1e-b9f2-c33be1b69c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.361534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9e813c97-cf37-4b1e-b9f2-c33be1b69c84 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:08.362742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9e813c97-cf37-4b1e-b9f2-c33be1b69c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:08.438734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c69de-d861-4e39-9cfd-5c2d4fcdec12 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.439353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c69de-d861-4e39-9cfd-5c2d4fcdec12 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.439818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c69de-d861-4e39-9cfd-5c2d4fcdec12 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.442628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 157/296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:02:08.446889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.447516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.447983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.455520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 140/297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:08.456829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe929ff-ac64-4e84-b1ca-6a6663c1484a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.457111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe929ff-ac64-4e84-b1ca-6a6663c1484a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.457387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe929ff-ac64-4e84-b1ca-6a6663c1484a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.458690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 141/298] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:08.464563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.464854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.465129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.470153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:08.471687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:08.485753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:08.486937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:08.561094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 158/299] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:08.571236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 142/300] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:08.738231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:08.784508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:08.850872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b22b21-bfbc-47d5-8af4-cb6970993e17 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:08.851853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:08.887824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:08.888450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:08.888728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:08.888996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:08.899200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:08.899368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:08.905153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:08.906121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 159/301] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:08.912844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:08.975156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee1ca1-e596-404c-9f7a-160491c3348c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.012073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.012975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.013403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.013691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.019561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396a159-1a37-4d5d-9681-70466f7ca63e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.021526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.024114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:09.029900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:09.030799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:09.031556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 143/302] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:09.032652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.064790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.065412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.065689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.065987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.067079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.068498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.070085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 160/303] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:09.070941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.140582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.143850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450e410-033f-4b12-b64f-fc5302600ced None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.178938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.179659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.179834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.180096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.180763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:09.181066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.183019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.184028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862ca-82fd-4e12-8dfd-1c5e4895287e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.196071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 144/304] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:09.196071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.226261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.226870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.227154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.227540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.228324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:09.228821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.230274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.243613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 161/305] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:09.243613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.281905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.305845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b51ab6-84de-4952-8613-fcf099a84c07 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.345172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.346268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.346745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.347241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] PATH_INFO: `/v3/groups` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.348057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.349913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.357491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d986b-07a0-4bf6-ab42-c71ac36a34c6 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.367893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 145/306] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Aug 30 00:02:09 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:09.369671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.398121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.416435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.417991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.418466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.418917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] PATH_INFO: `/v3/users/10e7f367cb694146a5b6d5ba520a75e0` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.420820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] RBAC: Authorizing `identity:get_user(user_id=10e7f367cb694146a5b6d5ba520a75e0)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.423322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.426466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 162/307] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/users/10e7f367cb694146a5b6d5ba520a75e0 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:09.432129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.501312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81591a5e-086a-41c1-a535-5cfc9a2692dc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.543030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.544200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.544200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.544200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] PATH_INFO: `/v3/users/f4a31105440a40d58b2583262623c7aa` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.561568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] RBAC: Authorizing `identity:get_user(user_id=f4a31105440a40d58b2583262623c7aa)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.563362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.566847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 146/308] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/users/f4a31105440a40d58b2583262623c7aa => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:09.573648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:09.578400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.581615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c1a2d-af0b-461d-b93a-d86bccdbddf4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.627699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a985438-0229-473b-aca7-47a5b8db9ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.628606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985438-0229-473b-aca7-47a5b8db9ae3 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.629352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985438-0229-473b-aca7-47a5b8db9ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.629640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985438-0229-473b-aca7-47a5b8db9ae3 None admin] PATH_INFO: `/v3/system/users/10e7f367cb694146a5b6d5ba520a75e0/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.631934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a985438-0229-473b-aca7-47a5b8db9ae3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=10e7f367cb694146a5b6d5ba520a75e0, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.633733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a985438-0229-473b-aca7-47a5b8db9ae3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.646326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 163/309] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Aug 30 00:02:09 2022] PUT /identity/v3/system/users/10e7f367cb694146a5b6d5ba520a75e0/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:09.679053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:09.702938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f544-cc68-475c-99ca-dfc912ec636a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:09.743692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:09.744429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.744879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.745162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.746049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] RBAC: Adding query filter params (role.id=b5b4891f9d964c70b218a76d167f6a3c, user.id=f4a31105440a40d58b2583262623c7aa, scope.system=all) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:09.746530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:09.748107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ffa4b4-b7aa-4375-9e8f-bd0b3757f8d8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:09.754807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 147/310] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 00:02:09 2022] GET /identity/v3/role_assignments?user.id=f4a31105440a40d58b2583262623c7aa&scope.system=all&role.id=b5b4891f9d964c70b218a76d167f6a3c => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:09.768644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a540-8dd0-42d9-8fc5-b1b6ab344aae None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.768926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a540-8dd0-42d9-8fc5-b1b6ab344aae None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.769238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110a540-8dd0-42d9-8fc5-b1b6ab344aae None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.770781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 164/311] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:09.777363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:09.777657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:09.777969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:09.798757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:09.799928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:09.878824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 148/312] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:10.165041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a540-8dd0-42d9-8fc5-b1b6ab344aae None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.278750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110a540-8dd0-42d9-8fc5-b1b6ab344aae None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.316986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.317617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.317929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.318208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.329375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:10.334643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:10.335504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:10.336550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 165/313] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:10.342571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.421252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:10.447538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c309f2-7b47-4c21-b2f4-4341a2bbcdff None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.483069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.483675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.483958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.484233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.484896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:10.485197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.486610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.495115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 149/314] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:10.500592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.527927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:10.607128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781437a-9fcd-42e6-b497-ad96bc102aa5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.642851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.643487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.643769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.644046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] PATH_INFO: `/v3/users/2580c92e1a72404e83bf2a400fb2b065` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.645186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] RBAC: Authorizing `identity:get_user(user_id=2580c92e1a72404e83bf2a400fb2b065)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.646662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.648298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 166/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/users/2580c92e1a72404e83bf2a400fb2b065 => generated 297 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:10.654358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:10.758501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b4c32-8464-4437-a88e-cf391c795677 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:10.796766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:10.797382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:10.797664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:10.797964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:10.801634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:10.868141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:10.869754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:10.972934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 150/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:10.979524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.075604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.084095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ebb23-b0b4-4043-a8f1-d9b1855d09fb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.119908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abac13c-1354-4b92-8b9c-996a6b57ec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.120537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abac13c-1354-4b92-8b9c-996a6b57ec3c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.120822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abac13c-1354-4b92-8b9c-996a6b57ec3c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.121099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abac13c-1354-4b92-8b9c-996a6b57ec3c None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.122314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abac13c-1354-4b92-8b9c-996a6b57ec3c None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.123817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abac13c-1354-4b92-8b9c-996a6b57ec3c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.125455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 167/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:10 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:11.131563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.174070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.235813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad578c-3a91-41c0-84ce-e21093361f04 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:11.272052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:11.272657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.272936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.273208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.273966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] RBAC: Adding query filter params (role.id=b5b4891f9d964c70b218a76d167f6a3c, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7, user.id=2580c92e1a72404e83bf2a400fb2b065) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:11.274276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:11.276522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb1d13-9bbc-4ae8-9eba-b95659b35452 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:11.282699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 151/318] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:11 2022] GET /identity/v3/role_assignments?user.id=2580c92e1a72404e83bf2a400fb2b065&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=b5b4891f9d964c70b218a76d167f6a3c => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:11.483460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a9fe3-6a85-4c9e-9a27-52d985d384e8 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.483837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a9fe3-6a85-4c9e-9a27-52d985d384e8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.484021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a9fe3-6a85-4c9e-9a27-52d985d384e8 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.485654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 168/319] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:11.491142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78177d-1c7c-476b-9968-423227cc50fd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.491581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78177d-1c7c-476b-9968-423227cc50fd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.491775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78177d-1c7c-476b-9968-423227cc50fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.512720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2c78177d-1c7c-476b-9968-423227cc50fd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:11.513982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2c78177d-1c7c-476b-9968-423227cc50fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:11.585801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 152/320] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:11.663461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c60cd-3b90-4ee0-bd6d-0a6a4c2d1091 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.663982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c60cd-3b90-4ee0-bd6d-0a6a4c2d1091 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.664089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c60cd-3b90-4ee0-bd6d-0a6a4c2d1091 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.665483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 169/321] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:11.670480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.670775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.671053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.689615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:11.690827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:11.715395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:11.751902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b807f-ab1b-477f-b1be-c1f382c84830 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.752174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b807f-ab1b-477f-b1be-c1f382c84830 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.752361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b807f-ab1b-477f-b1be-c1f382c84830 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.753737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 170/322] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:11.758949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:11.759294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:11.759528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:11.765847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 153/323] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:11.777429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:11.778653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:11.846577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 171/324] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:11.862561 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:11.965028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2352d-1e2c-41e9-972c-f96b26f28f15 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.001251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.001897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.002228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.002445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.003608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.005293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.009751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 154/325] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:12.013249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.030125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.065004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:12.115186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:12.125590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d77d6-4c87-49c4-b614-8c35525c3cdb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.149337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4fe0-c9fe-421c-9cae-7421b3132daf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.160830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.161435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.161734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.162026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] PATH_INFO: `/v3/groups` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.162667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.164148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.180617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 172/326] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Aug 30 00:02:12 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:12.181954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.196194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.196883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.197165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.197438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.210223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:12.216154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:12.217113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:12.217924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 155/327] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:12.223199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.302291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83380689-e854-4a0b-b401-e1070c722ac4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.318757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:12.335334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac939b6b-d55b-40ab-bb1f-3a96b03f932c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.343839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.344861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.344861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.345058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.360072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:12.365505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:12.366412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:12.367179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 173/328] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:12.372458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.383518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.384127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.384442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.384826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.385536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:12.385864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:12.386731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.388105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.397496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 156/329] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:12.404136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.495209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc47bd-be01-48c9-9676-5f3e68939534 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.520514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04230d-b79d-4c3e-bb24-cabddfebe5d7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.537842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.538986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.540746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.541287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.542497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:12.542806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.544177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.553821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 174/330] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:12.558960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.577977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.578969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.579328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.579681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] PATH_INFO: `/v3/users/10e7f367cb694146a5b6d5ba520a75e0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.581093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] RBAC: Authorizing `identity:get_user(user_id=10e7f367cb694146a5b6d5ba520a75e0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.582880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.584960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 157/331] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/users/10e7f367cb694146a5b6d5ba520a75e0 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:12.593419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.619253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:12.674217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:12.711906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1869c-fa50-4775-bb8e-8e2af5b29945 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.727538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1747d787-c87f-4488-a2f3-827dc595bfda None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.765375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.768041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.768041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.768041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] PATH_INFO: `/v3/users/f4a31105440a40d58b2583262623c7aa` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.768041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] RBAC: Authorizing `identity:get_user(user_id=f4a31105440a40d58b2583262623c7aa)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.769224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.771180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 175/332] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/users/f4a31105440a40d58b2583262623c7aa => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:12.777588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:12.782061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.782909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.783400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.783885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.785781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] RBAC: Adding query filter params (role.id=aa7cc9bc9e7a431ba36301ab51130045, user.id=10e7f367cb694146a5b6d5ba520a75e0, scope.system=all) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:12.786348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.788009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e0331-7ef3-4bf6-9c90-b5a16309a322 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.810043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 158/333] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 00:02:12 2022] GET /identity/v3/role_assignments?user.id=10e7f367cb694146a5b6d5ba520a75e0&scope.system=all&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:12.931031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7bdb-0bbf-4a4d-88a4-758c96262586 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:12.976409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09257964-bc76-4f68-b82b-a5ecdd8cebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:12.977077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257964-bc76-4f68-b82b-a5ecdd8cebb5 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:12.977360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257964-bc76-4f68-b82b-a5ecdd8cebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:12.977638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257964-bc76-4f68-b82b-a5ecdd8cebb5 None admin] PATH_INFO: `/v3/system/users/f4a31105440a40d58b2583262623c7aa/roles/b5b4891f9d964c70b218a76d167f6a3c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:12.980206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257964-bc76-4f68-b82b-a5ecdd8cebb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f4a31105440a40d58b2583262623c7aa, role_id=b5b4891f9d964c70b218a76d167f6a3c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:12.981630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257964-bc76-4f68-b82b-a5ecdd8cebb5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:12.995722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 176/334] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Aug 30 00:02:12 2022] PUT /identity/v3/system/users/f4a31105440a40d58b2583262623c7aa/roles/b5b4891f9d964c70b218a76d167f6a3c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:14.423660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0db92-552d-436b-b0ca-8cdf27c2bd32 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:14.424199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0db92-552d-436b-b0ca-8cdf27c2bd32 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:14.424272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0db92-552d-436b-b0ca-8cdf27c2bd32 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:14.425882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 159/335] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:14.431945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98a9ae-df75-4aed-a9e0-3177785fdd08 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:14.432411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98a9ae-df75-4aed-a9e0-3177785fdd08 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:14.432593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98a9ae-df75-4aed-a9e0-3177785fdd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:14.441256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:14.454901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-af98a9ae-df75-4aed-a9e0-3177785fdd08 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:14.456776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-af98a9ae-df75-4aed-a9e0-3177785fdd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:14.533752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 177/336] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:14.745120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141113-5846-4ab2-bfd3-7bdc971c0bfe None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:14.745441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141113-5846-4ab2-bfd3-7bdc971c0bfe None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:14.745629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9141113-5846-4ab2-bfd3-7bdc971c0bfe None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:14.747323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 160/337] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:14.752628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23881-7a24-4521-9b8d-cebe6bd1022b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:14.752927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23881-7a24-4521-9b8d-cebe6bd1022b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:14.753197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f23881-7a24-4521-9b8d-cebe6bd1022b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:14.777980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-87f23881-7a24-4521-9b8d-cebe6bd1022b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:14.779204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-87f23881-7a24-4521-9b8d-cebe6bd1022b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:14.857159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 178/338] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:15.040133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141113-5846-4ab2-bfd3-7bdc971c0bfe None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.063077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b36e9-5115-492a-be25-a4e3513a902f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.063723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b36e9-5115-492a-be25-a4e3513a902f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.064204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b36e9-5115-492a-be25-a4e3513a902f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.065778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 179/339] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:02:15.092078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.092691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.093164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.124171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:15.125689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:15.132282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:15.168662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9141113-5846-4ab2-bfd3-7bdc971c0bfe None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:15.226732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:15.227713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.228235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.228812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.234614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:15.246509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:15.252179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:15.253390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:15.255731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:15.256616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 180/340] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:15.258557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 161/341] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:15.264783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.336814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.443593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03cbc-a21a-482c-af6a-12a4cfe2017e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:15.511530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d29422-20a8-4a5c-9324-12cf027b2f79 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:15.531742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:15.532515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.532901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.533268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.534087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:15.534599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:15.536187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:15.550545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 181/342] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:15.556685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.573142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:15.574085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.574618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.575031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.585032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:15.597293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:15.603630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:15.604601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:15.605425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 162/343] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:15.612564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.645328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:15.744608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd472820-7903-4465-8879-6c74e2da64c1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:15.750149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a9bd9-9aa6-4943-b643-a9774fef7358 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:15.791583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:15.795435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.795920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.796422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.797293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:15.797892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:15.799751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:15.817024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 163/344] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:15.818380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:15.831507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:15.832452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:15.833042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:15.834935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:15.947449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:15.976024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:15.978616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:16.002656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba7d26-bb12-442b-a547-179f0c4f652c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:16.050459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:16.051100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.051378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.051648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.070514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:16.075908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:16.076786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:16.077577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:16.079891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 164/345] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:16.084796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:16.087876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.149314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 182/346] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:16.150970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:16.280205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38550507-c215-4a27-84cf-d3987c3dfbe4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:16.290978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c31f65-f7de-40a7-b2f5-34af26ed2556 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:16.310667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.325157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:16.325804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.326095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.326370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.327936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:16.327936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:16.328884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:16.334272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6b0fa-b063-48ff-ad62-ad408cbbd1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:16.335249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6b0fa-b063-48ff-ad62-ad408cbbd1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.335690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6b0fa-b063-48ff-ad62-ad408cbbd1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.336110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6b0fa-b063-48ff-ad62-ad408cbbd1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.339066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 183/347] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:16.340183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:16.365035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.425923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6b0fa-b063-48ff-ad62-ad408cbbd1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:16.427393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f6b0fa-b063-48ff-ad62-ad408cbbd1c1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:16.462016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b43962f-978d-49c0-9c30-d8cf697e94b8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:16.503102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c774dfb-d7b7-402c-b41b-c95d827d8033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:16.503976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774dfb-d7b7-402c-b41b-c95d827d8033 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.504406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774dfb-d7b7-402c-b41b-c95d827d8033 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.505121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c774dfb-d7b7-402c-b41b-c95d827d8033 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.507523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774dfb-d7b7-402c-b41b-c95d827d8033 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:16.509386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c774dfb-d7b7-402c-b41b-c95d827d8033 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:16.511845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 184/348] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:16.513227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a1ea-b0f7-48f8-be47-768b7fe79d56 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.513784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a1ea-b0f7-48f8-be47-768b7fe79d56 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.514279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887a1ea-b0f7-48f8-be47-768b7fe79d56 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.517261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 185/349] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:16.518288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a1ea-b0f7-48f8-be47-768b7fe79d56 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:16.553042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 165/350] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:16.558600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.559672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.559960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.582141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:16.583724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:16.600434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.634862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.658276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887a1ea-b0f7-48f8-be47-768b7fe79d56 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:16.673114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 166/351] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:16.674041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:16.718166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c91051-0d85-4ba6-8a6c-9eafb943c10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:16.719156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91051-0d85-4ba6-8a6c-9eafb943c10f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.719642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91051-0d85-4ba6-8a6c-9eafb943c10f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.720115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c91051-0d85-4ba6-8a6c-9eafb943c10f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.803753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7f3f7-162d-4e1d-89c6-ba9090e5af18 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:16.816451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c91051-0d85-4ba6-8a6c-9eafb943c10f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:16.818245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c91051-0d85-4ba6-8a6c-9eafb943c10f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:16.846644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:16.847509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.847950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.848228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.858377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:16.859866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:16.861532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 167/352] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:16.862335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:16.884373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.948393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:16.961411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 186/353] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:16.967741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faacaa0-0fc1-4ce0-848d-d0ad877dbc59 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.968032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faacaa0-0fc1-4ce0-848d-d0ad877dbc59 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.968304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faacaa0-0fc1-4ce0-848d-d0ad877dbc59 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.969641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 187/354] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:16.971265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23127a1-473d-4920-8aa6-a28abe33ffba None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:16.971721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23127a1-473d-4920-8aa6-a28abe33ffba None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:16.972220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23127a1-473d-4920-8aa6-a28abe33ffba None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:16.973301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 188/355] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:16.974346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23127a1-473d-4920-8aa6-a28abe33ffba None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.014801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039544-de4d-4932-9be8-da2d777672e1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.058518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.058694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.058907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.059128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.061740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.061740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.063921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 168/356] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.068715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.095554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23127a1-473d-4920-8aa6-a28abe33ffba None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.132728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.133342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.133627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.133949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.135229 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=a8ea83b074d1446f9c350a5375eada88) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:17.135544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.137025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.142771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 189/357] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:16 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.143417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.177563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.198314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7dcc3-4fc3-4ef4-8329-9ba5f3294289 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.204727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.260021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec2801-5df2-4db6-bbae-e1f26f5a224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.260751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec2801-5df2-4db6-bbae-e1f26f5a224c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.261157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec2801-5df2-4db6-bbae-e1f26f5a224c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.261531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec2801-5df2-4db6-bbae-e1f26f5a224c None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.262921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec2801-5df2-4db6-bbae-e1f26f5a224c None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.265452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec2801-5df2-4db6-bbae-e1f26f5a224c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.269801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 169/358] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.269801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.269801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.269801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.287050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084abdf6-b986-4481-bfb2-3507a12655da None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.291403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:17.291738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:17.342601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceffe8-5fea-4f58-a9f6-b0566faf8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.343169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceffe8-5fea-4f58-a9f6-b0566faf8133 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.343832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceffe8-5fea-4f58-a9f6-b0566faf8133 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.343832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceffe8-5fea-4f58-a9f6-b0566faf8133 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.357100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceffe8-5fea-4f58-a9f6-b0566faf8133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-5cceffe8-5fea-4f58-a9f6-b0566faf8133 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:17.364213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:17.365288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:17.366346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 190/359] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:17.367133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.367133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.367133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.390011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 170/360] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:17.390011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.396842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:17.398235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:17.483744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 191/361] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:17.484822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.491402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.533157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410a06ed-3358-414f-8b44-85bcb534a451 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.572645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.604115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.604749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.605031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.605309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.606605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.608055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.610909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 171/362] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.611686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.669356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20e32-815d-44a9-a2b1-cb5ee7bd58fa None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.724486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.725851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.726178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.726750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.728501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.730401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.733308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 192/363] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.734451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.769540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccc6c2-a2e9-4937-9273-51cac657fe5e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.808967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.809583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.809927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.810234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.810883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:17.811190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.812574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.821674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 172/364] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.822614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.837306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.874963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5c01-36cb-478d-add9-b261225233c2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:17.889212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:17.937128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:17.938639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:17.938639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:17.938639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:17.939104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=a8ea83b074d1446f9c350a5375eada88) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:17.939416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:17.940930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:17.947085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 193/365] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=ca37184ac9034a398797d8994e2ce144 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:17.947911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:17.949282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ba772-e634-45a1-8a9a-06829a509991 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.001433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.002475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.003489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.003959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.021453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:18.029572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:18.030550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:18.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:18.034537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 173/366] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:18.035843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.076445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded98286-14dd-453a-bc3c-52a7b8a816b1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.132444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:18.134320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.135362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.135859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.136783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.137656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:18.139040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.140491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:18.147886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 194/367] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:17 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:18.148036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.173624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ae391-bf86-47d8-87da-12d65e20d477 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.230544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:18.236307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.237023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.237312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.237591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] PATH_INFO: `/v3/users/f4a31105440a40d58b2583262623c7aa` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.239524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] RBAC: Authorizing `identity:get_user(user_id=f4a31105440a40d58b2583262623c7aa)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.241031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:18.244532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 174/368] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/users/f4a31105440a40d58b2583262623c7aa => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:18.245400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.361386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b157a40-2576-4abf-be39-9fc0a5b9455f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.409329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.410008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.410272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.410547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.423171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:18.426262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5021aa-1420-4fa3-8367-74d76fcdddaf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:18.428839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:18.429780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:18.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 195/369] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:18.431262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.494646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.497484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.497891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.498181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.498875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:18.499183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.500690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:18.511107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:18.526307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 175/370] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:18.527482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.542547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:18.548629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6727313a-7e34-4f41-bbcd-0480f6692332 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.591344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.592298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.592835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.593117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.593891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] RBAC: Adding query filter params (role.id=b5b4891f9d964c70b218a76d167f6a3c, user.id=f4a31105440a40d58b2583262623c7aa, scope.system=all) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:18.594208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.596534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:18.625596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 196/371] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/role_assignments?user.id=f4a31105440a40d58b2583262623c7aa&scope.system=all&role.id=b5b4891f9d964c70b218a76d167f6a3c => generated 510 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:18.626684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.752469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838cc32-45e0-40d0-9e62-d5e8925bd89c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.794253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.795233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.795738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.796227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.797102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:18.797610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.800224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:18.801066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689f30f-a8f4-43cd-ac2f-cfb8bf56e2a3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:18.811644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 176/372] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:18.817550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:18.848550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:18.849239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:18.849530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:18.849842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:18.889210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:18.908110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:18.978592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:18.980072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.002179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91474a-b989-479f-a397-fc299d80de14 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.046947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.047550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.047841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.048123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.124043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.125534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.176610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 197/373] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:19.182898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.188109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:19.235573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 177/374] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:19.240769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.301475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:19.402621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3178b-194b-42a4-a2ff-1bb64cd133ce None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.461968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2524d3-8286-4697-a676-70574d81367f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.462183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102648-535d-4308-a867-233f640258eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.462667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102648-535d-4308-a867-233f640258eb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.463123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102648-535d-4308-a867-233f640258eb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.463411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102648-535d-4308-a867-233f640258eb None admin] PATH_INFO: `/v3/projects/d5371435029143138d8fb9e32ebf3198` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.464581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102648-535d-4308-a867-233f640258eb None admin] RBAC: Authorizing `identity:get_project(project_id=d5371435029143138d8fb9e32ebf3198)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.466039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102648-535d-4308-a867-233f640258eb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.468004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 198/375] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:19 2022] GET /identity/v3/projects/d5371435029143138d8fb9e32ebf3198 => generated 344 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:19.474634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102648-535d-4308-a867-233f640258eb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.515832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.516812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.517323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.517827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.519885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.521543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.526575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 178/376] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:19 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:19.534660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.579596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:19.645938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102648-535d-4308-a867-233f640258eb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.693774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:19.706389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c681d7b0-1830-4949-9496-3e9dd09eef7b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.708175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541d2a48-0109-4568-8d69-fe79c9abe4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.709061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2a48-0109-4568-8d69-fe79c9abe4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.709546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2a48-0109-4568-8d69-fe79c9abe4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.710061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541d2a48-0109-4568-8d69-fe79c9abe4f1 None admin] PATH_INFO: `/v3/groups/ebdaef3838724ae5993c311cbafc3505` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.717361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d2a48-0109-4568-8d69-fe79c9abe4f1 None admin] RBAC: Authorizing `identity:get_group(group_id=ebdaef3838724ae5993c311cbafc3505)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.719115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541d2a48-0109-4568-8d69-fe79c9abe4f1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.721004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 199/377] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:19 2022] GET /identity/v3/groups/ebdaef3838724ae5993c311cbafc3505 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:19.722387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5729172-91a7-4c31-8dd5-2207258eba45 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.722887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5729172-91a7-4c31-8dd5-2207258eba45 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.723379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5729172-91a7-4c31-8dd5-2207258eba45 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.725056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 200/378] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:19.727581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5729172-91a7-4c31-8dd5-2207258eba45 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.747456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd901a-676c-40a2-afa2-47288ac84ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.748097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd901a-676c-40a2-afa2-47288ac84ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.748383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd901a-676c-40a2-afa2-47288ac84ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.748665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd901a-676c-40a2-afa2-47288ac84ba5 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.749849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd901a-676c-40a2-afa2-47288ac84ba5 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.751323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd901a-676c-40a2-afa2-47288ac84ba5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.753223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 179/379] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:19 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:19.754451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.754993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.755284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.773376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:19.775214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:19.846080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 180/380] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:19.846708 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:19.849256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5729172-91a7-4c31-8dd5-2207258eba45 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:19.889590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:19.890587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:19.891071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:19.891543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:19.892510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] RBAC: Adding query filter params (group.id=ebdaef3838724ae5993c311cbafc3505, role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=d5371435029143138d8fb9e32ebf3198) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:19.893019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:19.894849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:19.898897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:19.903065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 201/381] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:19 2022] GET /identity/v3/role_assignments?group.id=ebdaef3838724ae5993c311cbafc3505&scope.project.id=d5371435029143138d8fb9e32ebf3198&role.id=46ba8574dccb497790ae947ec68f522d => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:19.988352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833175-39a2-489b-8ed5-814a8f9f545f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:20.033022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:20.033654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.034000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.034283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.035036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:20.035351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:20.036799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34235302-74b1-4c51-ba06-9d1b72fa4c81 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:20.043622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 181/382] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:19 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=ca37184ac9034a398797d8994e2ce144 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:20.203204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.275237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:20.320386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b64e2-065d-453a-895d-6cb619787fd2 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.321034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b64e2-065d-453a-895d-6cb619787fd2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.322058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b64e2-065d-453a-895d-6cb619787fd2 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.325024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 182/383] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:20.329514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.330059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.330524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.335939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ef8de-7c26-4597-bb25-4aea988b4690 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:20.355659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:20.357197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:20.377575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:20.378395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.378738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.379074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.396040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:20.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:20.402550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:20.403327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:20.407355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 202/384] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:20.408483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.472452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 183/385] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:20.548166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95904e6e-f97a-4347-a270-ae46ee32c62e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:20.560130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:20.586252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:20.587311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.587811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.588288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.589164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:20.589680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:20.591275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:20.601427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 203/386] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:20.606812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.630602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:20.724502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dc20b-531f-4b68-99ef-ac0c8f33fd2a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:20.771749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:20.772401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:20.772655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:20.772928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:20.774084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:20.775842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:20.777745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 184/387] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:20 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:20.782850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.872653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:20.985514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13ca2c-c3ee-4b14-b2d5-eed1dd2bc3bd None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.014063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.038482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccc160-a4b4-4861-b7ff-c84e3958014f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.067899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.068544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.068830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.069110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.071130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.072659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.074359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 204/388] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:20 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:21.080692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.109349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.110130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.110415 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.110704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.128740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:21.130603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:21.138993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:21.139937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:21.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 185/389] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:21.146288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.196653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feec2c4b-278d-4323-83d1-13198113ef2d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.235607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed71458-7019-4333-8ee7-9e50cfaa1ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.236196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71458-7019-4333-8ee7-9e50cfaa1ddc None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.236484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71458-7019-4333-8ee7-9e50cfaa1ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.236762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed71458-7019-4333-8ee7-9e50cfaa1ddc None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88/groups/29558393814848a4b066fc3189d72250/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.239472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71458-7019-4333-8ee7-9e50cfaa1ddc None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea83b074d1446f9c350a5375eada88, group_id=29558393814848a4b066fc3189d72250, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.240903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed71458-7019-4333-8ee7-9e50cfaa1ddc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.263813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 205/390] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 00:02:21 2022] PUT /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88/groups/29558393814848a4b066fc3189d72250/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:21.265402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94782d7-e8f2-41cf-b912-94f42e14db2c None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.265693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94782d7-e8f2-41cf-b912-94f42e14db2c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.265987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94782d7-e8f2-41cf-b912-94f42e14db2c None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.267700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 206/391] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:21.274106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.275333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.275760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.295831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c8e6f-e130-440b-9b1d-359c7662d53d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.301178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:21.302413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:21.340957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.342077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.342659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.343166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.344204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:21.344823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.346562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.362637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 186/392] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:21.370911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.398114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.403289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 207/393] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:21.513899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22824b57-82cb-47c7-8604-5af929b4ed67 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.553187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.553913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.554201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.554479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.555612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.557646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.559428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 187/394] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:21 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:21.564783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.600640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.694524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e0b82-e928-4130-b2c8-de147cb05b96 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.742480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.743822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.744109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.744383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.750097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:21.751550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:21.753564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 208/395] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:21 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:21.759679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.767451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.871669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.876557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dee79f-0956-46f1-87a4-8601f708b844 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:21.928213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:21.929131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:21.929734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:21.930168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:21.930770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:21.943109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:21.948808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:21.949679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:21.950545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:21.953080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 209/396] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:21.958822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:21.987993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328073-2d71-46a2-ae07-01639cc126d2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.063897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.064767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.065051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.065325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88/groups/29558393814848a4b066fc3189d72250/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.069849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdf3eb-d3c9-4207-9e81-e28f76107c5e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.071589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] RBAC: Authorizing `identity:create_grant(project_id=a8ea83b074d1446f9c350a5375eada88, group_id=29558393814848a4b066fc3189d72250, role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:22.075052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:22.108001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 188/397] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 00:02:21 2022] PUT /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88/groups/29558393814848a4b066fc3189d72250/roles/ca37184ac9034a398797d8994e2ce144 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:22.109398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.110272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.110757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.111344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.112227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:22.112738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:22.114383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:22.124963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 210/398] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:22.131469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:22.271865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d263bcd-bcfe-4a99-b565-07483929bcca None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.320512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f3cbf-12fe-4ca0-8409-2df9bcbbecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.322100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3cbf-12fe-4ca0-8409-2df9bcbbecd4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.322741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3cbf-12fe-4ca0-8409-2df9bcbbecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.323250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f3cbf-12fe-4ca0-8409-2df9bcbbecd4 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.324719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f3cbf-12fe-4ca0-8409-2df9bcbbecd4 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:22.326433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f3cbf-12fe-4ca0-8409-2df9bcbbecd4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:22.328546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 189/399] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:22 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:22.334420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:22.360103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:22.399126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45b98-39c4-479f-abd2-ff3cb892e852 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.400014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45b98-39c4-479f-abd2-ff3cb892e852 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.400337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa45b98-39c4-479f-abd2-ff3cb892e852 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.401953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 190/400] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:22.407627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840926-aa5b-4b83-ad00-f0fe8360bd0b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.408256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840926-aa5b-4b83-ad00-f0fe8360bd0b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.408774 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f840926-aa5b-4b83-ad00-f0fe8360bd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.438073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:22.454437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb91aea-af82-4c00-b75a-b1a75f5f5909 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.454711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8f840926-aa5b-4b83-ad00-f0fe8360bd0b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:22.455914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8f840926-aa5b-4b83-ad00-f0fe8360bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:22.492219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.492860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.493287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.493575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.494900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:22.497428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:22.499118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 211/401] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:22 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:22.506210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:22.533359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 191/402] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:22.603511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:22.616387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969e7ef-f245-4c4c-bfae-7adc021ce1e3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.624518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502b89a-0c92-424f-8885-1f0ed121bd9a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.625140 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502b89a-0c92-424f-8885-1f0ed121bd9a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.625617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502b89a-0c92-424f-8885-1f0ed121bd9a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.627737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 192/403] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:22.639834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.640387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.640858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.671103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.671820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.672110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.672390 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/groups/29558393814848a4b066fc3189d72250/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:22.674782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] RBAC: Authorizing `identity:create_grant(project_id=6d16856fa59d4597a4bd455b9b99c9d7, group_id=29558393814848a4b066fc3189d72250, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:22.676235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:22.679794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:22.681531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:22.704739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 212/404] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 00:02:22 2022] PUT /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/groups/29558393814848a4b066fc3189d72250/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:22.769846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 193/405] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:22.831508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:22.955344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c703b-76c3-4e3d-8a9f-b4459ae0093b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:22.993369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:22.994046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:22.994333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:22.994606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.005791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:23.012195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:23.013077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:23.013889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 213/406] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:23.019398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.116106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.130282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.142456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.173490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3c10b-aee2-4419-b81a-78a9e49bdc78 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.240484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.241111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.241394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.241668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.242378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:23.242799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.244471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.263781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24e330-306a-4ddf-96ac-09b5c959b7cf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.264998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 194/407] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:23.270237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.299876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.300608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.300895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.301170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.312426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:23.318274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:23.319145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:23.319914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 214/408] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:23.327108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.411219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.450492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ec25c1-2726-44d1-a997-ddadf855b53b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.491209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.492201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.492684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.493732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.494637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:23.495163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.496756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.507026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 215/409] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:23.516025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.527658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77182ac-91b0-49a7-91f3-0bc9d06507a3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.578150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.589205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.589878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.590167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.590449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.594068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.595528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.598565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 195/410] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:23.604965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.675433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec434bee-b713-4c1a-85ea-65ebeb06bd8d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.738168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:23.746160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.746806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.747096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.747376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] PATH_INFO: `/v3/groups/ebdaef3838724ae5993c311cbafc3505` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.753327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] RBAC: Authorizing `identity:get_group(group_id=ebdaef3838724ae5993c311cbafc3505)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.756950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.765218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 216/411] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/groups/ebdaef3838724ae5993c311cbafc3505 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:23.766452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.801822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b40793-8afd-4144-98f2-d1c72a2eb1df None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.869190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.870261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.870741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.871309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.874878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9af16c-93f5-44c9-acab-e7335ff991ca None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:23.875709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.877616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.879603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 196/412] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:23.886559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:23.938722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:23.939373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:23.939660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:23.939937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] PATH_INFO: `/v3/projects/d5371435029143138d8fb9e32ebf3198` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:23.943176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d5371435029143138d8fb9e32ebf3198)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:23.944636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:23.952391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 217/413] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:23 2022] GET /identity/v3/projects/d5371435029143138d8fb9e32ebf3198 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:23.956679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:24.018868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:24.056795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:24.065479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875b386-7fb0-4ed6-841d-b7a2299c321f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.095350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba71eae-7012-4354-b8f9-675f180911e5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.103372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9db374-037b-4a69-874e-e4e9f3265b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.104035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db374-037b-4a69-874e-e4e9f3265b7e None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.104314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db374-037b-4a69-874e-e4e9f3265b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.104584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9db374-037b-4a69-874e-e4e9f3265b7e None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/groups/29558393814848a4b066fc3189d72250/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.106917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9db374-037b-4a69-874e-e4e9f3265b7e None admin] RBAC: Authorizing `identity:create_grant(project_id=6d16856fa59d4597a4bd455b9b99c9d7, group_id=29558393814848a4b066fc3189d72250, role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:24.108460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9db374-037b-4a69-874e-e4e9f3265b7e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:24.130041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 197/414] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 00:02:23 2022] PUT /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7/groups/29558393814848a4b066fc3189d72250/roles/ca37184ac9034a398797d8994e2ce144 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:02:24.131367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5c4a-9a35-427a-824f-9f80746c1da9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.131714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5c4a-9a35-427a-824f-9f80746c1da9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.131997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea5c4a-9a35-427a-824f-9f80746c1da9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.134256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 198/415] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:24.145414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71464899-602d-4335-a9e5-dab7ad7ca1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.146204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464899-602d-4335-a9e5-dab7ad7ca1ed None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.146489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464899-602d-4335-a9e5-dab7ad7ca1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.146771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71464899-602d-4335-a9e5-dab7ad7ca1ed None admin] PATH_INFO: `/v3/projects/d5371435029143138d8fb9e32ebf3198/groups/ebdaef3838724ae5993c311cbafc3505/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.150308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46602e7-cb08-417e-a541-ee59bdbbae01 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.150711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46602e7-cb08-417e-a541-ee59bdbbae01 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.150867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46602e7-cb08-417e-a541-ee59bdbbae01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.156243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464899-602d-4335-a9e5-dab7ad7ca1ed None admin] RBAC: Authorizing `identity:create_grant(project_id=d5371435029143138d8fb9e32ebf3198, group_id=ebdaef3838724ae5993c311cbafc3505, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:24.157824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71464899-602d-4335-a9e5-dab7ad7ca1ed None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:24.183564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 218/416] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Aug 30 00:02:23 2022] PUT /identity/v3/projects/d5371435029143138d8fb9e32ebf3198/groups/ebdaef3838724ae5993c311cbafc3505/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:24.183990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b46602e7-cb08-417e-a541-ee59bdbbae01 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:24.185237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b46602e7-cb08-417e-a541-ee59bdbbae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:24.302488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 199/417] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:24.577671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed274fd-c45c-489e-8527-39c36ef629f6 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.578059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed274fd-c45c-489e-8527-39c36ef629f6 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.578190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed274fd-c45c-489e-8527-39c36ef629f6 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.579662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 219/418] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:24.584937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.585217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.585495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.590814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed274fd-c45c-489e-8527-39c36ef629f6 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:24.618225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:24.619438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:24.714142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed274fd-c45c-489e-8527-39c36ef629f6 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.727924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:24.751339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:24.765557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.766902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.767429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.767907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.779537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 200/419] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:24.780536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:24.785537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:24.786452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:24.787248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:24.794083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 220/420] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:24.796997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:24.907365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f2ef2-e438-4e76-b467-ac98fbf34df6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:24.944266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:24.944880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:24.945156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:24.945428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:24.946173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] RBAC: Adding query filter params (name=member) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:24.946480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:24.947852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:24.961152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 201/421] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:24.963104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.069033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a29e01-f057-4463-a2a7-e88293bf3582 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.108789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ade061-1e2a-40e4-a4b2-7038ce63c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.109396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ade061-1e2a-40e4-a4b2-7038ce63c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.109679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ade061-1e2a-40e4-a4b2-7038ce63c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.109976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ade061-1e2a-40e4-a4b2-7038ce63c2b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.152474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.177172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:25.205182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ade061-1e2a-40e4-a4b2-7038ce63c2b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:25.206674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ade061-1e2a-40e4-a4b2-7038ce63c2b1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:25.212679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:25.281038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b0a05-78d3-4db2-807d-396a77141663 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.328805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ade0e-4ee2-4b10-9c5a-db29f856ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.329441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ade0e-4ee2-4b10-9c5a-db29f856ea57 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.329732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ade0e-4ee2-4b10-9c5a-db29f856ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.330272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ade0e-4ee2-4b10-9c5a-db29f856ea57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.345473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ade0e-4ee2-4b10-9c5a-db29f856ea57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:25.350934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 221/422] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:25.352343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd721-8e6d-4df3-9e4e-e682c14dd9d5 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.352774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd721-8e6d-4df3-9e4e-e682c14dd9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.353063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6dd721-8e6d-4df3-9e4e-e682c14dd9d5 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.354596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 222/423] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c33ade0e-4ee2-4b10-9c5a-db29f856ea57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:25.355558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:25.356440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:25.357232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 202/424] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:25.363194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd721-8e6d-4df3-9e4e-e682c14dd9d5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.364112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.364393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.364664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.388134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:25.389867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:25.473960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:25.480171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 203/425] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:25.481047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.501862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6dd721-8e6d-4df3-9e4e-e682c14dd9d5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.546562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:25.571775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.572428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.572711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.572993 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.575224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:25.576679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:25.578363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 223/426] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:25.583981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.669099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a93da-b79b-4a39-af84-afcc5cc62a0d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.719566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.720177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.720456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.720727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.721391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:25.721692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:25.723087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:25.738648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 204/427] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:25.744814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.763250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c9cac-b28a-41bf-8e76-14e561b79633 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.797539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.798200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.798484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.798759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.799859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:25.801290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:25.808717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 224/428] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:25.810071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:25.878144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:25.899382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:25.904204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45499a55-9e84-4663-a8b3-8e3fd124d554 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.916860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d80ad-934b-4ed2-9f12-483c30bbf9ec None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:25.944431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.945280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.945791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.946895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.954543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:25.955149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:25.955431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:25.955700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:25.956429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=a8ea83b074d1446f9c350a5375eada88) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:25.956869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:25.958344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:25.973931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 225/429] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:25.975204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.024516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:26.025981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:26.132355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:26.139541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:26.146514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 205/430] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:26.156167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.159951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bf08e9-08a4-4e1d-84ee-2cb6d637be33 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.205368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:26.206301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.206831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.207240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] PATH_INFO: `/v3/roles/member` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.219713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:26.225524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:26.226643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 30 00:02:26.228080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:26.230046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 226/431] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:26.236367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.337791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e9eb5-7766-45f5-907d-aa329c1d2f75 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.350925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b1d87-479a-435e-91a0-247f431c44ee None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.376546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:26.377246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.377658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.377958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] PATH_INFO: `/v3/projects/a8ea83b074d1446f9c350a5375eada88` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.379185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] RBAC: Authorizing `identity:get_project(project_id=a8ea83b074d1446f9c350a5375eada88)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:26.380901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:26.383089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 206/432] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:26 2022] GET /identity/v3/projects/a8ea83b074d1446f9c350a5375eada88 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:26.388117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.392160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:26.393063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.393481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.394010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.394858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] RBAC: Adding query filter params (name=member) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:26.395329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:26.396904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:26.410243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 227/433] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:02:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:26.413196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.426918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:26.465745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:26.508463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836e92d0-4489-4cd9-8c2d-28bb67681200 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.529476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f06994-e676-4d45-b193-418cd5b2ea45 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.546369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b419b22-7512-478e-a7bd-3d9b9e5eed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:26.546996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419b22-7512-478e-a7bd-3d9b9e5eed49 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.547278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419b22-7512-478e-a7bd-3d9b9e5eed49 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.547551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b419b22-7512-478e-a7bd-3d9b9e5eed49 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.548744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419b22-7512-478e-a7bd-3d9b9e5eed49 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:26.550253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b419b22-7512-478e-a7bd-3d9b9e5eed49 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:26.554743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 207/434] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:26 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:26.556312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8116-5fd2-4af1-9a85-cd3ab6d43efe None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.556926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8116-5fd2-4af1-9a85-cd3ab6d43efe None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.557416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da8116-5fd2-4af1-9a85-cd3ab6d43efe None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.559010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 208/435] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:26.560081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da8116-5fd2-4af1-9a85-cd3ab6d43efe None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.568098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753fed1-91c9-4cc8-b290-b6c9fc656804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:26.568708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753fed1-91c9-4cc8-b290-b6c9fc656804 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.568987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753fed1-91c9-4cc8-b290-b6c9fc656804 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.569256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753fed1-91c9-4cc8-b290-b6c9fc656804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.658872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753fed1-91c9-4cc8-b290-b6c9fc656804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:26.660338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753fed1-91c9-4cc8-b290-b6c9fc656804 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:26.674183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:26.692605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da8116-5fd2-4af1-9a85-cd3ab6d43efe None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.738548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:26.739468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.739752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.740030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.740768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=a8ea83b074d1446f9c350a5375eada88) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:26.741078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:26.742582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89b0c4-2355-4a88-afd4-8c337548b09e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:26.744748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:26.749786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 209/436] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:26 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=a8ea83b074d1446f9c350a5375eada88&role.id=ca37184ac9034a398797d8994e2ce144 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:26.751230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d9755-3362-4757-994a-5e84c4ff3da4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.751830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d9755-3362-4757-994a-5e84c4ff3da4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.752108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d9755-3362-4757-994a-5e84c4ff3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.772955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-975d9755-3362-4757-994a-5e84c4ff3da4 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:26.774861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-975d9755-3362-4757-994a-5e84c4ff3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:26.793795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 228/437] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:26.793795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf892-e5f0-4165-8468-275d699b11f3 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.793795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf892-e5f0-4165-8468-275d699b11f3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.793795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cf892-e5f0-4165-8468-275d699b11f3 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.793795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 229/438] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:26.797075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cf892-e5f0-4165-8468-275d699b11f3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:26.874594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 210/439] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:26.874594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:26.874594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:26.874594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:26.892714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:26.894127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:26.954860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cf892-e5f0-4165-8468-275d699b11f3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:26.970129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.001074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 211/440] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:27.010019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.010999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.011366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.011709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.012972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:27.014642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:27.016677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 230/441] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:26 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:27.022551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.094513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.154097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310affc8-7a64-4e20-856e-bd019f27a80b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.204493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.204659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.205459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.205787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.206069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.207588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:27.209452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:27.211282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 212/442] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:27.217268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.348082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447aa92e-135e-4e5a-b822-90b6cabbe5c9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.358994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9b941-1415-45ac-a3a4-ffde18cb4821 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.387591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.396356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.396987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.397270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.397537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.400642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.402190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.402473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.403574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.404330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=aa7cc9bc9e7a431ba36301ab51130045, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:27.404642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:27.406094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:27.408971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:27.413391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 213/443] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=aa7cc9bc9e7a431ba36301ab51130045 => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:27.413908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:27.426851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:27.427652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:27.428355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.428428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 231/444] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:27.428428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.463380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.555637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181aa42-2920-4192-9947-1384373d01a1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.568771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c721dc-4ebf-4b3d-9f87-c2bdea47ddf4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.603744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.604314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.604602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.604876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.605554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:27.605902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:27.608147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:27.616345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.616990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.617278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.617612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.619848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 232/445] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:27.626551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.632806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:27.640006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:27.640926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:27.642132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 214/446] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:27.649406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.714133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.748322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.755896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95109d37-d3c3-46af-a436-95a6e2ed3e92 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.784779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdee6e6-263e-4c3b-87af-a2f483453d50 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.795948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.796559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.796843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.797118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.819702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.820307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.820593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.820868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.821586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:27.821923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:27.823316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:27.831861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 215/447] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:27.838003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:27.865719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:27.867282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:27.939151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f3e9f-918f-47bd-a8b1-d3db264bf74a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:27.952422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.969093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:27.973682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 233/448] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 30 00:02:27.975406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:27.976025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:27.976311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:27.976586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:27.979966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:28.050424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.051889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.081668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d680a-56e8-419e-be9c-7bfc8f8676b0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:28.116262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:28.116883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:28.117165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:28.117439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] PATH_INFO: `/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:28.118734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] RBAC: Authorizing `identity:get_project(project_id=6d16856fa59d4597a4bd455b9b99c9d7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.120165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.121808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 234/449] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/projects/6d16856fa59d4597a4bd455b9b99c9d7 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:28.127193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:28.150982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 216/450] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:28.156840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:28.171541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:28.194261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:28.231026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc1c5-5bdd-4f92-a403-b28c58c8bcb2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:28.257117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dff18a3-eea5-44ac-bb98-b25cd65351c5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:28.272205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:28.272835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:28.273117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:28.273393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] PATH_INFO: `/v3/groups/29558393814848a4b066fc3189d72250` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:28.275297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] RBAC: Authorizing `identity:get_group(group_id=29558393814848a4b066fc3189d72250)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.276976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.278589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 235/451] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:28 2022] GET /identity/v3/groups/29558393814848a4b066fc3189d72250 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:28.284281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:28.292608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:28.293297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:28.293575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:28.293875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] PATH_INFO: `/v3/projects/d5371435029143138d8fb9e32ebf3198` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:28.294987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] RBAC: Authorizing `identity:get_project(project_id=d5371435029143138d8fb9e32ebf3198)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.296421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.298059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 217/452] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:02:28 2022] GET /identity/v3/projects/d5371435029143138d8fb9e32ebf3198 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:28.303492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:28.381777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:28.381976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d9df9-e967-4597-9452-13cc422d4477 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:28.402119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bb009-c7f2-423e-9d78-da340efc8424 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:28.417102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:28.417697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:28.418010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:28.418284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:28.419010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] RBAC: Adding query filter params (group.id=29558393814848a4b066fc3189d72250, role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:28.419319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.420730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.422491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:28.428162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 236/453] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:28 2022] GET /identity/v3/role_assignments?group.id=29558393814848a4b066fc3189d72250&scope.project.id=6d16856fa59d4597a4bd455b9b99c9d7&role.id=ca37184ac9034a398797d8994e2ce144 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:28.440997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0d73f5-d0e0-438d-8ddf-623ed1e07a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:28.441656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d73f5-d0e0-438d-8ddf-623ed1e07a44 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:28.441971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d73f5-d0e0-438d-8ddf-623ed1e07a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:28.442248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d73f5-d0e0-438d-8ddf-623ed1e07a44 None admin] PATH_INFO: `/v3/groups/ebdaef3838724ae5993c311cbafc3505` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:28.443465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d73f5-d0e0-438d-8ddf-623ed1e07a44 None admin] RBAC: Authorizing `identity:get_group(group_id=ebdaef3838724ae5993c311cbafc3505)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.444961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0d73f5-d0e0-438d-8ddf-623ed1e07a44 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.447692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 218/454] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Aug 30 00:02:28 2022] GET /identity/v3/groups/ebdaef3838724ae5993c311cbafc3505 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:28.453917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:28.560366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d70d4c-9495-4bf3-82fe-95a27bf70d02 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:28.597406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:28.598035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:28.598322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:28.598595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:28.599322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] RBAC: Adding query filter params (group.id=ebdaef3838724ae5993c311cbafc3505, role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=d5371435029143138d8fb9e32ebf3198) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:28.599632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:28.601050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53267638-5ee6-44e2-8c86-da8e34dd3cce None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:28.607053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 237/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Aug 30 00:02:28 2022] GET /identity/v3/role_assignments?group.id=ebdaef3838724ae5993c311cbafc3505&scope.project.id=d5371435029143138d8fb9e32ebf3198&role.id=46ba8574dccb497790ae947ec68f522d => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:30.888439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f120-45b9-437c-8752-ec20a4501403 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:30.888974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f120-45b9-437c-8752-ec20a4501403 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:30.888974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa0f120-45b9-437c-8752-ec20a4501403 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:30.890331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 219/456] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:30.895669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cdf82-474b-4127-8ee5-13873b1860e9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:30.896062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cdf82-474b-4127-8ee5-13873b1860e9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:30.896248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cdf82-474b-4127-8ee5-13873b1860e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:30.940311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-101cdf82-474b-4127-8ee5-13873b1860e9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:30.941510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-101cdf82-474b-4127-8ee5-13873b1860e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:31.030281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.035322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 238/457] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:31.096258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11372a-6866-48d8-ab93-a47a0832d4cb None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.096592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11372a-6866-48d8-ab93-a47a0832d4cb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.096809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11372a-6866-48d8-ab93-a47a0832d4cb None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.098427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 220/458] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:31.109647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555f97-2d0c-43a8-b3cd-06d09797804f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.110214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555f97-2d0c-43a8-b3cd-06d09797804f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.110698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57555f97-2d0c-43a8-b3cd-06d09797804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.134932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-57555f97-2d0c-43a8-b3cd-06d09797804f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:31.136405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-57555f97-2d0c-43a8-b3cd-06d09797804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:31.219120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 239/459] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:31.451567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20edbf3-fd8b-4cf3-a407-faeaea3d2450 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.452294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20edbf3-fd8b-4cf3-a407-faeaea3d2450 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.452779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20edbf3-fd8b-4cf3-a407-faeaea3d2450 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.454564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 221/460] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:31.460518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20edbf3-fd8b-4cf3-a407-faeaea3d2450 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:31.464907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.465500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.470213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.502782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:31.504478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:31.622381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 240/461] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:31.623473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:31.646493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20edbf3-fd8b-4cf3-a407-faeaea3d2450 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:31.680960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.718963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:31.719591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.720051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.720511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.730541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695761c0-c805-4c17-bc25-5ccc5759083c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:31.740167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:31.741830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:31.766616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.768667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:31.769457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.769912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.770326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:31.778453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:31.779543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:31.780540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:31.780540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:31.780540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:31.780540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 222/462] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:31.785112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:31.785412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:31.786966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:31.802622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:31.803718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:31.804739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:31.804739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:31.804739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:31.807511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 241/463] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:31.813353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:31.923519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63c42b-fd7d-49f5-baed-651decb48619 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:31.927284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:31.960041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f5888-1ef0-4127-ad98-0203f088a5c1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:31.963464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:31.964074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:31.964502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:31.964918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:31.965738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:31.966232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:31.967739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:31.983902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 242/464] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:31.989034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:32.005514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:32.006170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.006450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.006721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.007361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:32.007663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:32.009740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:32.025880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 223/465] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:32.025880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:32.084251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:32.103690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae6d52-2a15-4263-845e-592eeab3ef3c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:32.128872 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527ac56-1f18-4dc3-b6ea-f62a52c7a835 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:32.141645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:32.142314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.142599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.142872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.155792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:32.157282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:32.165443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:32.166320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.166700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.167064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.167881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:32.169308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-70b82815-35d0-4586-b7b7-0b548e457ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:32.174369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:32.175240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:32.176085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:32.176085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:32.176085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:32.182352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 243/466] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:32.183815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3723ad-26c5-44b1-b9cc-b129cfeb283d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.184107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3723ad-26c5-44b1-b9cc-b129cfeb283d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.184506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3723ad-26c5-44b1-b9cc-b129cfeb283d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.190187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 244/467] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:32.190944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3723ad-26c5-44b1-b9cc-b129cfeb283d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:32.201874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 224/468] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:32 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:32.201874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:32.223562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:32.337013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550f36d-da74-4d86-9dce-fa75a621887b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:32.346021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3723ad-26c5-44b1-b9cc-b129cfeb283d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:32.355667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:32.381454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:32.382112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.382397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.382702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.383999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:32.384309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:32.385804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d3ca4-4564-4c91-b1aa-a907078907e6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:32.393787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:32.394914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.394914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.394914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.395619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:32.397120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:32.399676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 225/469] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:32.400920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62066d-41c6-4edf-8052-86db34ac1bc3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.401285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62066d-41c6-4edf-8052-86db34ac1bc3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.401563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62066d-41c6-4edf-8052-86db34ac1bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.423602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 245/470] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:32 2022] POST /identity/v3/users => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:32.424087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7b62066d-41c6-4edf-8052-86db34ac1bc3 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:32.424992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:32.425428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7b62066d-41c6-4edf-8052-86db34ac1bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:32.518818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:32.532214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 226/471] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:32.534111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a62d-be8d-4809-bb9d-96c19c54585e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.534405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a62d-be8d-4809-bb9d-96c19c54585e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.535179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814a62d-be8d-4809-bb9d-96c19c54585e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.537051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 227/472] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:32.543180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.543471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.543751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.556407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2de83-46cf-46e2-970e-6258cea9dc0b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:32.566013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:32.567641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:32.595855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:32.596391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:32.596678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:32.596953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:32.597608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:32.599085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:32.631802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 246/473] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:32 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:32.654572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 228/474] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:32.870405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:32.987888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c00f5-5cb6-42ad-846b-0108a6e6f453 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:33.002835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:33.029688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:33.042985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:33.044220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:33.044964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:33.045465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:33.050783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:33.060197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:33.062621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:33.083310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:33.084212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:33.085037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:33.085037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:33.085037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:33.088646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 247/475] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:33.094480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:33.125937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4681dda9-bd58-4b30-8157-f00998f4d176 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:33.165316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:33.165896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:33.166309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:33.166654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:33.167420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:33.169008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:33.177354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.sql.core [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:02:33.177354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:02:33.177354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [parameters: {'id': 'f81d6979ae5b4ef4b0a858365e41cf0c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:02:33.177354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81661) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 30 00:02:33.197354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return ref.to_dict() Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:02:33.198283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application yield resource Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise self.value Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application session.commit() Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:02:33.199168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:02:33.200039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:02:33.200900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:02:33.201697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [parameters: {'id': 'f81d6979ae5b4ef4b0a858365e41cf0c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:33.203339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 30 00:02:33.204230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:33.205876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 229/476] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 00:02:33 2022] POST /identity/v3/roles => generated 144 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:33.206516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:33.213251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03dab8-a0ec-47e8-92e8-079b2a74fb8e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:33.251067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:33.251941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:33.252298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:33.252646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:33.253376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:33.253779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:33.255607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:33.275747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 248/477] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:33.281303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:33.365722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:33.376470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:33.383890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4ecc8-956a-43ae-98dc-e0f65e299760 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:33.421600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:33.422272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:33.422553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:33.422847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:33.434174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:33.439078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:33.439944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:33.440706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 230/478] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:02:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:33.447183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:33.483728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c390b-12de-4b1a-b2d1-3148cf54d534 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:33.550209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341dcdc8-5572-4b5c-bc5b-9865b4d1d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:33.550765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee1e9ce-03b6-4642-badf-953a64c1d77a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:33.550878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dcdc8-5572-4b5c-bc5b-9865b4d1d24a None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:33.551090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dcdc8-5572-4b5c-bc5b-9865b4d1d24a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:33.551372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341dcdc8-5572-4b5c-bc5b-9865b4d1d24a None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:33.552052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dcdc8-5572-4b5c-bc5b-9865b4d1d24a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:33.553665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341dcdc8-5572-4b5c-bc5b-9865b4d1d24a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:33.590408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:33.591104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:33.591490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:33.591719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:33.592625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:33.593018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:33.594593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deff40a-cbba-4a86-958b-9797d102702e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:33.598675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 249/479] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:33 2022] POST /identity/v3/users => generated 249 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:02:33.604848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 231/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:34.567626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255eef4-a3ea-427f-9642-2659d04e55e5 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:34.568646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255eef4-a3ea-427f-9642-2659d04e55e5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:34.569133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255eef4-a3ea-427f-9642-2659d04e55e5 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:34.571539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 250/481] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:34.577160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1a4a6-2608-486e-9f5f-f87d66ebbcfa None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:34.578007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1a4a6-2608-486e-9f5f-f87d66ebbcfa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:34.578488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1a4a6-2608-486e-9f5f-f87d66ebbcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:34.597757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-dec1a4a6-2608-486e-9f5f-f87d66ebbcfa None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:34.599264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dec1a4a6-2608-486e-9f5f-f87d66ebbcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:34.616520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:34.688371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 232/482] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:34.960343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0147fc6-e7d4-4a85-b3e3-b57b4c540e05 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:34.960663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0147fc6-e7d4-4a85-b3e3-b57b4c540e05 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:34.960911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0147fc6-e7d4-4a85-b3e3-b57b4c540e05 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:34.962719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 251/483] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:34.968083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f814f-70a4-43bd-b45c-a064f1f2320c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:34.968378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f814f-70a4-43bd-b45c-a064f1f2320c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:34.968656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f814f-70a4-43bd-b45c-a064f1f2320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:34.988969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6e4f814f-70a4-43bd-b45c-a064f1f2320c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:34.990273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6e4f814f-70a4-43bd-b45c-a064f1f2320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:35.061698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 233/484] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:35.103341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0147fc6-e7d4-4a85-b3e3-b57b4c540e05 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.205542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a035ff-04e0-4846-9243-979be6be7dda None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.205858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a035ff-04e0-4846-9243-979be6be7dda None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.206044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a035ff-04e0-4846-9243-979be6be7dda None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.207645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 234/485] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:35.213475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.213789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.214067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.225016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:35.241013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:35.242717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0147fc6-e7d4-4a85-b3e3-b57b4c540e05 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:35.244502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:35.304212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:35.304841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.305152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.305434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.324416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:35.330126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:35.331073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:35.331864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:35.340227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 252/486] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:35.346575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.346930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 235/487] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:35.456632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e9633-589f-405b-888a-e3de3eea6331 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:35.490225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.507244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:35.523495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:35.524446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.526185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.526664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.527737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:35.529017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:35.531133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:35.550556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 253/488] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:35.558656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.594263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:35.653986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fcb70-4731-4bb7-9570-b8505cc5cb70 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:35.693282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:35.694089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.694371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.694644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.706061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:35.711835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:35.712714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 236/489] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:35.718220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.734891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206d41d-94cf-41f1-ae4a-6032cabd627a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:35.785624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:35.786651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.787647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.788185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.803323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:35.806190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:35.809036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:35.827231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:35.828411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:35.829448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:35.829448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:35.829448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:35.831188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 254/490] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:35.831779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.850269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf033d2-6e82-4c8e-b804-d45ab7c92fe2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:35.888476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:35.889503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.890015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.890513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.902221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:35.907648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:35.908527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:35.909311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:35.912049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 237/491] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:35.913216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:35.913679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:35.949739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddae44-01dd-45f2-99fc-1aac8bddd602 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:35.987964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:35.988490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:35.988822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:35.989100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:35.989878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:35.990185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:35.991684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.006038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 255/492] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:36.006038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.036177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06e0ed-d526-4641-8344-7fc48a8d6d40 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.070333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.076315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.077284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.077852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.078330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.079245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:36.079766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.081647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.094641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 238/493] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:36.095972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.125910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5788d6-8acf-4d2a-b799-bf52336ca616 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.156008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.161478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.162115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.162399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.162676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.163374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:36.163681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.165737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.174364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 256/494] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:36.174970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.214159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec2bba-318a-4a3f-9e57-50fa23065d39 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.252101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.253088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.253647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.254096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.266185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.267824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.281348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46dc02-ce16-4eaf-a376-375fc54ccb35 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-00879d57-2852-4dc1-893a-73793a6dde22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:36.283890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:36.284803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:36.285638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:36.285638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:36.285638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:36.285638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 239/495] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:36.286269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaea72-1f94-4eae-8532-de37884975ed None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.286562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaea72-1f94-4eae-8532-de37884975ed None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.286839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceaea72-1f94-4eae-8532-de37884975ed None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.288376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 240/496] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:36.289097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaea72-1f94-4eae-8532-de37884975ed None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.323161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.323796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.324079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.324352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.332601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.334487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.347167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-885392c2-da38-4d15-9878-b98eb27d7618 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:36.347930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:36.348859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:36.349757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 257/497] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:36.350531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.350660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.350987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.369268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:36.370510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:36.408374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fceaea72-1f94-4eae-8532-de37884975ed None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.420895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.439424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 258/498] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:36.440330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.457219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.457892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.458177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.458454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.469948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.471402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ba001fbe-f4bf-40e6-98d7-8a6fea22afa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:36.486032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:36.486996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:36.487806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:36.487806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:36.487806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:36.487806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 241/499] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:36.488648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c137-bfb7-4628-80d8-659900bedc4d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.488941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c137-bfb7-4628-80d8-659900bedc4d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.489215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3c137-bfb7-4628-80d8-659900bedc4d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.490592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 242/500] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:36.495299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3c137-bfb7-4628-80d8-659900bedc4d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.552367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142379b8-93e9-4cc1-8636-467f23e2268f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.591103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.591955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.592376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.592793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.593435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:36.593759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.595116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.603491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.610935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3c137-bfb7-4628-80d8-659900bedc4d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.611611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 259/501] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:36.612579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.647799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.648407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.649355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.649533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.650333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:36.651186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.652071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990acfb-13a9-467d-93a2-91000d1b1c2b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.661508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.690188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 243/502] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:36.691510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.691869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.692215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.712370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:36.713597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:36.721893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc492ba-385b-4aab-b486-50ef9b907cf7 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.755815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.756721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.757008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.757455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.758730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:36.759260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.760690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.772342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 260/503] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:36.773220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.780593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 244/504] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:36.781427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:36.872463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.887519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83500d12-e60b-4478-a115-b1d17f8e503d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.890765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:36.890901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0038f7-545b-4cca-8693-0fcb20e64089 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:36.926724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.927443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.927729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.928005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.933267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:36.934111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:36.934590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:36.935039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:36.935868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:36.937592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:36.950350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:36.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:36.952119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 261/505] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:36.952654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.015041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.017260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.060489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b1fe8-6899-48e8-a5ed-4012174b6428 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.093823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.094441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.094721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.094989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.104638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.105587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.107199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.121392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 245/506] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:37.121736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:37.122619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:37.123482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:37.123482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:37.123482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:37.123644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.123710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 262/507] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:37.123710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.144305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.227366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a144718-0d54-46ee-8235-50bf94b3835d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.231574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156f8dc-3f50-42d4-b517-969ba3099daf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.265055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.265654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.265966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.266235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.266955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:37.267056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.267255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.267680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.267964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.268236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.268657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.276279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.277767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:37.291060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:37.291968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:37.292880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 246/508] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:37.293616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.307758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 263/509] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:37.308610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.342270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.384303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.397566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560cb23-dcc1-43c5-9b06-15cb99045104 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.410172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e2803-5d19-4dc6-8f8f-d6f7ebaf13d2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.431715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.432330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.432608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.432879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.443099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:37.445197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.445970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.446251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.446523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:37.448522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:37.449402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:37.450224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 247/510] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:37.450861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.458862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.460318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:37.474730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:37.475851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:37.477372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:37.477372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:37.477372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:37.477372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 264/511] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:37.477763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.554371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8f9bd-b83e-4b53-8ffd-97a1dd4db327 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.557435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.577830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc6f953-42e5-4810-955a-89e50dc6c7bf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.589445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.590085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.590369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.590644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.591297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:37.591605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.592984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.603612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.607600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 248/512] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:37.608770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.616886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.618232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.618501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.618779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.619627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:37.619934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.621354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.639432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 265/513] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:37.640021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.707952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5b1a5-e21f-46ce-874c-6840eb033020 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.739129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63da14-93b9-43ac-88f4-b74ed1b136e3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.741405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.742040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.742847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.743294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.774084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.774281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.774692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.774972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.775248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.775957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:37.776295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.777800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.785791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 266/514] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:37.786532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.812073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.813530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.834200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:37.887133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250eb316-832b-47b0-a72c-f4030feee047 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:37.911343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 249/515] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:37.912072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.923353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:37.923967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:37.924249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:37.924520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:37.925167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:37.925468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:37.926861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:37.943051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 267/516] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:37.943051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:37.980045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.018920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d26c4d-051d-4d31-bbb6-700f1151590a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.038088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640bc6c1-3f14-4f94-9354-597561e243ee None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.045825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.054070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.054675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.054978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.055251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.055894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.057318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.075039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.075643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.075927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.076202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.078250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 250/517] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:37 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:38.079060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.162029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.163429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.198610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc592b2-d4cd-4313-85be-cc54032c17b1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.221724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.239639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.240266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.241189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.241189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.252595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.254154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:38.275536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:38.276491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:38.277298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:38.277298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:38.277298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:38.277298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 251/518] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:38.277514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.281023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 268/519] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:38.282636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.294222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.391428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361fd4bd-d0a2-495e-8f95-b5a597bbfbb9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.394976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421ba18-b451-4027-93cd-d879fca4daa9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.426919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.427482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.427732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.428002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.431174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.431806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.432091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.432368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.435798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.437225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.443944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.445464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:38.449954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:38.450757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 269/520] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:38.456639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:38.468165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:38.469059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:38.470325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:38.470325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:38.470325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:38.473832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 252/521] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:38.474866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.500917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.529797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.571533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a17035-818f-48ef-98b1-3c5fd675e54d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.588295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2b839-44cb-4283-94c2-a5639b172a09 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.613267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.614054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.614643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.614919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.615716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:38.616018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.617934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.622667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.623299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.623581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.623854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.635158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 270/522] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:38.635158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.639671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.641168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:38.655714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:38.656773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:38.657777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:38.657777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:38.657777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:38.657777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 253/523] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:38.657777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.736975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.749238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b309-dd03-4e20-a016-73de15fe5c82 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.763645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f721a92-e73a-4588-91e6-7a80a8815bea None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.779676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.791675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.792381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.792731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.793075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.793862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:38.794170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.795585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.799277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.800253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.800548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.800827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.801475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:38.801814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.803216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.813584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 271/524] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:38.814422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.822042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 254/525] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:38.823645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.927462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb1ddc-c6dd-4fba-aab3-613117bc269d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.935133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23fbcc8-fd04-4288-88eb-c4e1bb9657c1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:38.963354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.963983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.964321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.964599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.971326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:38.971844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.971949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:38.972195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:38.972463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:38.973101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:38.973286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.973380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:38.974893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:38.977951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:38.991772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 255/526] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:38.991772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:38.992000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:38.993464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 272/527] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:38.994447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.040785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.098616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dae62-b6ed-4980-a210-537c87e68999 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.102541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1daca8-d7da-49e6-8a54-c9d38a433d0c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.136421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.136649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.137175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.137457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.137750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.137911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.138330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.138484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=274f72b3a3c34d6388ff820627f2f4cc) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:39.138800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.139114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.140243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.145577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 256/528] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/role_assignments?user.id=274f72b3a3c34d6388ff820627f2f4cc&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:39.146389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.155675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.157254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:39.171602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:39.172545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:39.173376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:39.178497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 273/529] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:39.179665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.230111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.277994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad897b-eed6-440a-a5e6-c6e8383b7d53 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.304777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350831d-6ab6-4076-bc5a-5bb58c058fee None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.312754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.325139 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.326506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.326999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.327508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.338101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.340294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.345819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.346506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.346792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.347067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.347798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:39.348106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.349523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:39.355662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:39.356651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:39.357509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 257/530] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:39.358844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.373348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 274/531] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:39.374612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.486341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63066e-e835-456e-bd72-b0d9f91c33c2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.487033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df1270-80d1-4bbe-962a-b1e601b578b8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.517517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.524123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253425-06af-4303-b941-be2e86dc164b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.525051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253425-06af-4303-b941-be2e86dc164b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.525544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253425-06af-4303-b941-be2e86dc164b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.526053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01253425-06af-4303-b941-be2e86dc164b None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.526969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01253425-06af-4303-b941-be2e86dc164b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:39.527509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01253425-06af-4303-b941-be2e86dc164b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.529165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01253425-06af-4303-b941-be2e86dc164b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.535170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.535786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.536069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.536346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.537048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:39.537360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.539707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.544663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 275/532] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:39.545951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253425-06af-4303-b941-be2e86dc164b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.568728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 258/533] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:39.568728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.577421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.675205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01253425-06af-4303-b941-be2e86dc164b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.694783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0aeb-58af-4a02-997a-3df2180fda34 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.717402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.718042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.718330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.718606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.735049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.736006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.736485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.736971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.738085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=0f458d5fcb964638be06e1bf21869250) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:39.739158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.740961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.747614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 259/534] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/role_assignments?user.id=0f458d5fcb964638be06e1bf21869250&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:39.748798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.804293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.818189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.819977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.854587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:39.921050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc9fab-c790-4e34-b771-c907685cce05 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:39.959281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 276/535] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:39.964531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:39.975045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:39.975971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:39.976931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:39.977476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:39.978917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=118462014bfa41e388b6bb0be1d208d0) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:39.979675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:39.982178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8434c6-17b1-4303-90b7-b83c3ed1b318 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:39.988555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 260/536] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/role_assignments?user.id=118462014bfa41e388b6bb0be1d208d0&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:40.141865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2f5c-864f-481a-b096-bada4c21d1dd None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:40.173332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:40.186175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:40.187108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.187614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.188108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.199645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:40.201328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7db7d-c1a8-4747-bb9f-abfe575ec4b7 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.201616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7db7d-c1a8-4747-bb9f-abfe575ec4b7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.201919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7db7d-c1a8-4747-bb9f-abfe575ec4b7 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.203455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 261/537] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:40.204814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:40.209116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.209400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.209676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:40.228727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:40.230086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:40.230947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:40.230947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:40.230947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:40.230947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 277/538] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:40.238143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:40.241822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:40.243644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:40.330120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 262/539] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:40.420501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f6445-6ceb-4aa1-939e-72efe306aba0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:40.468800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:40.469408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.469693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.469992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.470643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:40.470950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:40.474833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:40.488687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 278/540] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:40.494210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:40.539946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:40.618473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1f438-abf1-4123-b364-fa2eb492dad8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:40.662063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:40.662703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.662985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.663258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.675075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:40.676475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:40.688460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:40.689271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:40.690111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 263/541] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:40.698227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:40.746961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:40.812706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:40.864617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f6c76-8424-483f-a69c-91373e0e47d1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:40.938354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:40.938894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:40.939178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:40.939454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:40.940152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:40.940457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:40.941918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:40.975957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 279/542] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:40.982609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:40.983686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:40.988768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713c0b25-6693-4069-96c9-219275cd76f0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.040131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.040776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.041060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.041334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.065042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:41.070827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:41.071710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:41.072464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 264/543] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:41.079126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:41.125221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:41.131255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5cfc2-41af-4931-a841-6a9070c450c0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.181696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.182640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.183066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.184682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.185630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=2e45f572e4d94afc98c4a68b11ab4b36) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:41.186292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:41.189638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:41.196802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 280/544] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:40 2022] GET /identity/v3/role_assignments?user.id=2e45f572e4d94afc98c4a68b11ab4b36&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:41.249604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfff64-dfb9-43f4-8b99-69a203dc280a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.306074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.306702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.306987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.307261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.307944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:41.308250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:41.309635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9a646-2ac3-4e3d-8318-4c7488970075 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:41.319035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 265/545] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:41.327115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:41.438624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba12b8-68cd-4b7d-9052-7f06d08513eb None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.438624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba12b8-68cd-4b7d-9052-7f06d08513eb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.438624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aba12b8-68cd-4b7d-9052-7f06d08513eb None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.439871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 266/546] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:41.446386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.446671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.446948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.459766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98b8a0-c976-4377-88aa-59282a06b930 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.485890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:41.488329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:41.512799 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.513736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.514194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.514636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.516589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:41.536510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:41.538284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:41.567787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:41.568723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:41.569537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:41.569537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:41.569537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:41.571735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 281/547] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:41.577339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:41.606119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:41.625811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 267/548] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:41.732658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eca056-5a10-4bee-afb3-ecfec4eb5ac2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.783777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.784660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.785085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.785502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.786385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:41.786829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:41.788342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:41.806772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 282/549] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:41.812183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:41.919633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c40ae-500f-46f4-bae4-58f71b79e9f5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:41.961740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:41.962612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:41.963030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:41.963434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:41.975490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:41.977373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:41.992133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:41.993765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:02:41.995012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:41.997121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 268/550] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:42.002680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.002803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.030119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.128753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.176003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f3bd5-65bb-4ab3-b4da-1f3a0ea3c9f4 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.182312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f741e3-f0c5-491d-b45f-08467404302d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.215583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f57278-240e-4010-a317-09413a1df73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.216213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57278-240e-4010-a317-09413a1df73d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.216495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57278-240e-4010-a317-09413a1df73d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.216770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f57278-240e-4010-a317-09413a1df73d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.227204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f57278-240e-4010-a317-09413a1df73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:42.229808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.230419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.230704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.230978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.231716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-c1f57278-240e-4010-a317-09413a1df73d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:42.231959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:42.232769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:42.233744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:42.234364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:42.234430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 283/551] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:42.234963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5461-dee8-4427-bf57-46ee270e0cd7 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.235112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5461-dee8-4427-bf57-46ee270e0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.235331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde5461-dee8-4427-bf57-46ee270e0cd7 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.236697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 284/552] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:42.238213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8467429-189b-4d2e-b85f-4d74929a4e28 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:42.241244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539391-a4a0-4250-aff1-41da0ea14393 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.241591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539391-a4a0-4250-aff1-41da0ea14393 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.241910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48539391-a4a0-4250-aff1-41da0ea14393 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.244595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 285/553] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:42.246736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539391-a4a0-4250-aff1-41da0ea14393 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.258877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 269/554] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:42.260429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbbf97-f387-4506-8028-b4277aa54733 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.260541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbbf97-f387-4506-8028-b4277aa54733 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.260780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedbbf97-f387-4506-8028-b4277aa54733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.278489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cedbbf97-f387-4506-8028-b4277aa54733 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:42.279753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cedbbf97-f387-4506-8028-b4277aa54733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:42.345727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.352584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 270/555] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:42.353894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.354179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.354451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.371602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48539391-a4a0-4250-aff1-41da0ea14393 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.374098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:42.375290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:42.404643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.411679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.413066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.413983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.414454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.415334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:42.415813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:42.417386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:42.428640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 286/556] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:42.430563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.457745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 271/557] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:42.457745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.609457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478347c-d349-4cce-a4b3-b5ff0960ac03 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.640181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46f7fa-7068-467b-9efe-3c0060efa2cb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.673636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.674281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.674568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.674847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.682603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.692045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.692852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.693244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.693738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.706776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:42.709108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:42.730622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:42.731523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:42.732338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:42.732338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:42.732338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:42.732588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 272/558] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:42.733577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.750733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.761438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:42.763078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:42.854223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd7a328-1dbf-4065-8b4a-6e886dc73b4e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:42.869431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 287/559] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:42.870124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.894059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:42.894687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:42.894964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:42.895228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:42.906212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:42.913757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:42.914849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:42.915650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 273/560] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:42.920470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:42.964852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.980116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:42.988551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4577f9ab-db3e-4d11-9042-7cc1bffce16d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.025476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.026114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.026393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.026660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.027088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a8978-2656-4371-8093-ea71f38bac21 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.027306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:43.027605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.028950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.040929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 288/561] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:43.041594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.067150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.067785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.068069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.068339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.080134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:43.086495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:43.087389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:43.088283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:43.088900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 274/562] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:43.089462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.154628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a7d331-62f7-45c4-9784-944f9a93552a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.190704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.191337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.191622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.192071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.194919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.198666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117690be-6bdf-4bc1-bed6-02b9d4c7ab52 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.206590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.208153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:43.223417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:43.224364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:43.225242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:43.225242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:43.225242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:43.225242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 289/563] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:43.225467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.235715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.238424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.239039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.239321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.239593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.240260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:43.240574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.241990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.250865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 275/564] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:43.251697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.343171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5067a95-2e58-49cb-b499-a6050e666c79 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.352648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd18d4b-c9eb-4045-bc9b-d84ba34d87dd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.381001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.382050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.382661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.383329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] PATH_INFO: `/v3/users/glance` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.387156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.387764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.388045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.388318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.388980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:43.389289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.390686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.392900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.394517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.398830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 276/565] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:43.399645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:43.409813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:43.410950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:02:43.412119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:43.414911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 290/566] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:43.416060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.434833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.483643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.510699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909056e-3cbd-4abb-b061-ea6620ff0614 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.519516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0ae06-72e0-4365-87c7-3629ce31e2ff None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.544192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.544796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.545078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.545355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.546026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:43.546332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.547714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.552902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.553518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.553834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.554113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.560826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 277/567] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:43.561618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.566424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.567868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:43.582219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:43.583161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:43.584020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:43.584020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:43.584020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:43.584020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 291/568] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:43.584565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.650467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.667070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3ae4-bc6c-4d17-a343-e568e9c968e2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.686924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2e2da-6feb-4f90-b735-5be712e590cc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.700876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.701500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.701828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.702105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.703298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.712759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.714239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.722129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.723109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.723397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.723667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.724389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:43.724692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.726102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b8de48e4-f76e-4e57-a189-f9a6f168ca43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:43.729374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:43.730289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:43.731221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:43.731221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:43.731221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:43.731221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 278/569] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:43.731963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94346a-6172-45c6-b5b4-24a823e2687f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.732249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94346a-6172-45c6-b5b4-24a823e2687f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.732524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94346a-6172-45c6-b5b4-24a823e2687f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.733922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 279/570] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:43.734457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94346a-6172-45c6-b5b4-24a823e2687f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.750098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 292/571] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:43.750932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.835181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94346a-6172-45c6-b5b4-24a823e2687f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.850825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155adcb6-7c85-43ed-9a31-b37b1e5fa1d9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:43.869282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.869942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.870228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.870502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.873137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.877776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.879390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.886322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:43.886925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.887206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.887477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.888116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:43.888418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:43.889776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1491752a-7bb5-46c8-aa3b-198142612944 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:43.891095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:43.892032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:43.893044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:43.897030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 280/572] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:43.897730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:43.901509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 293/573] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:43.902729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:43.903018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:43.903293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:43.923435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:43.924650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:43.953507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:43.992382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 294/574] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:43.993199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.004918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde0668-b501-4599-8727-e6f22f9c6478 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.043504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.044109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.044390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.044668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.045293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:44.045601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.047025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.060031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 281/575] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:44.064967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.099677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63460ca2-a01c-47c1-aa19-d1813bb1298d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.126698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.136677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.137309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.137596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.137901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.149569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.151037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:44.168420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:44.169360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:44.170639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:44.170639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:44.170639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:44.170639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 295/576] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:44.170639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.178184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85979981-b2d2-4440-844c-b16656bf9114 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.189722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.217249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.217879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.218160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.218429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.219172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:44.219479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.220921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.237312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 282/577] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:44.237312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.282754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68051252-f00d-47dc-914c-d9ffb8ab01cb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.315646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.316261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.316539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.316846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.325131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.326582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:44.338577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:44.339506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:02:44.340426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:44.341127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353eb72-9751-412f-b2af-069c7c27ff9c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.341201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 296/578] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:44.341201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.356146 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.374890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.375510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.375791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.376065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.384667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.386131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:44.397026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:44.397964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 283/579] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:44.399447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.424558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.447295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153f8a-27cc-4439-9d98-cf7e06e6f2dc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.482475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.483078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.483366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.483645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.484293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:44.484601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.485987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.498178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 297/580] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:44.498971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.505934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732491c-80fb-43d8-a2ea-6de8bf2abb09 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.538975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.539672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.539959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.540240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.540970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=5be0312450644dd69a7c7263e347b28b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:44.541304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.542749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.547955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 284/581] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/role_assignments?user.id=5be0312450644dd69a7c7263e347b28b&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:44.548733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.597212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.606484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474f51-a75d-4633-bc30-be8cc6fdcf39 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.645861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.646511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.646790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.647073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.654860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.658963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:44.665046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:44.666280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:44.667118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 298/582] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:44.667813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.674339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e40ed16-dfb2-4ade-8449-796db000010f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.714724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.715249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.715545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.715818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.716540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:44.716848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.718327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.736247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 285/583] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:44.737077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.792879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9675-c91c-42de-90f3-34d0300f992d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.832173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.833054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.833486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.834050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.835066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:44.835534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.836826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.838350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.841032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b488b1-de22-48a2-bb44-ac22ef9babbe None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:44.859595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 299/584] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:44.860742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.882441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:44.883109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:44.883484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:44.883764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:44.890616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:44.892063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:44.903283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:44.904211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:44.905087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 286/585] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:44.905571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:44.935132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:44.982930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f02210-22c8-4095-950e-8691d4b2a6dc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.014387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a3786-d3c6-47b1-9aba-e3a813493d77 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.019851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.020462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.020746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.021021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.021697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:45.022034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.023432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.036508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 300/586] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:45.036508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.057553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.058306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.058655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.058993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.069606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.071226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:45.086428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:45.087401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:45.088262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:45.088262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:45.088262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:45.088262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 287/587] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:45.088262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.102245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.147885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32d4c3-2303-4cb0-a303-8239187f980f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.168852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.188606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.189426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.190062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.190348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.196035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0951ddf-556b-4e32-a540-ec3271eeb8c4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.201352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.202818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:45.217501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:45.218832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:45.219705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:45.219705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:45.219705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:45.219705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 301/588] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:45.219923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.238322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.238866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.239148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.239533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.240335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:45.240592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.242809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.258712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 288/589] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:45.259845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.328363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00a562-b62b-4131-932f-56637bb802c6 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.333074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.366010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.366260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ade84-79b1-45da-bf7b-04861724bd2d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.366793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.367770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.368265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.379316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.381069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:45.397500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:45.398643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:45.400142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:45.400142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:45.400142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:45.400142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 302/590] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:45.400142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.408161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.408782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.409067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.409344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.410034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:45.410342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.411705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.427813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 289/591] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:45.427813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.430408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.509642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c50ddd-e9e4-467d-bb9e-7695e606e122 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.544501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.545111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.545396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.545672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.546359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:45.546677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.548029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.551519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a7eeb-7a37-4bf7-bc68-299c2db82666 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.560332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 303/592] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:45.561152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.586499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.593910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.594569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.594854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.595138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/274f72b3a3c34d6388ff820627f2f4cc/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.611894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=274f72b3a3c34d6388ff820627f2f4cc, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.613444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.627412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 290/593] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:45 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/274f72b3a3c34d6388ff820627f2f4cc/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:45.628650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.666171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.693366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cdfd4-72fc-48ef-a1b8-018333d385d0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.741288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.741967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.742249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.743160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.743827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:45.744133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.746098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.763601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 304/594] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:45.764861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.782106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509bc6e2-f3b5-4331-be09-edd70002b36f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.828784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.829440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.829928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.830207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.840008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.841213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:45.854586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:45.855489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:45.856390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 291/595] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:45.856861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.900292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a96c6-8d5b-4c75-a753-568bf1ab785b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:45.923649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.952391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:45.953178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:45.953566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:45.953964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:45.961425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:45.963032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:45.974654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:45.975768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:45.976890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:45.978586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 305/596] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:45.979560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:45.982383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:45.988346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e8893-a5a6-4e23-8257-cfc5f4bb09cb None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.038112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.038821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.039209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.039762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.047475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.049029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:46.062310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:46.063479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:02:46.064606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:46.066493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 292/597] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:46.067638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.115292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d412767-81d2-47d7-a36e-f1e877d330c9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.151917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.152588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.152818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.153100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.153828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:46.154163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.155571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.168839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 306/598] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:46.169800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.189156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.194168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75c47d4-32db-44a4-813a-75378b555464 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.232706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.233813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.234308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.234807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.235662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.236223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:46.237049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.238708 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.253369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 293/599] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:46.254857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.279042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96fc9-22aa-4ebb-89ad-554383750313 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.314741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.315271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.315558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.315836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.316574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:46.316880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.318357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.337681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 307/600] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:46.338246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.369211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3b4c8-fc16-404d-b982-0013c5308e7f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.412207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.412917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.413194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.414135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/0f458d5fcb964638be06e1bf21869250/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.433274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=0f458d5fcb964638be06e1bf21869250, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.435619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.452438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6f0a8-1d73-40ed-8cf7-831885205666 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.453674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 294/601] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:46 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/0f458d5fcb964638be06e1bf21869250/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:46.456057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.473207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.483795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.519063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13470e80-8e18-4b58-9ab1-ca56f8c037de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.520738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13470e80-8e18-4b58-9ab1-ca56f8c037de None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.521021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13470e80-8e18-4b58-9ab1-ca56f8c037de None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.521296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13470e80-8e18-4b58-9ab1-ca56f8c037de None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/118462014bfa41e388b6bb0be1d208d0/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.545446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13470e80-8e18-4b58-9ab1-ca56f8c037de None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=118462014bfa41e388b6bb0be1d208d0, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.547093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13470e80-8e18-4b58-9ab1-ca56f8c037de None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.565300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 308/602] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:46 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/118462014bfa41e388b6bb0be1d208d0/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:46.567484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b52ec-e834-451e-9190-01f5bdd94a1a None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.568375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b52ec-e834-451e-9190-01f5bdd94a1a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.568920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b52ec-e834-451e-9190-01f5bdd94a1a None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.572156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 309/603] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:46.578428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.579378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.579834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.605669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:46.608292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:46.627981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17bd5b-5550-42a8-aede-ae5ae71257c1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.671987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.672628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.672906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.673173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.688086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.690641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.705784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 310/604] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:46.714511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:46.715549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:46.716427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:46.716427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:46.716427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:46.716427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 295/605] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:46.725872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.861570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c418da-124e-42fc-8047-9ce17d25f083 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:46.863534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:46.900040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:46.900995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:46.901991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:46.902488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:46.903334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:46.903838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:46.905395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:46.918314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 311/606] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:46.924819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:46.999749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.049391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.056309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55589b8e-61fe-41f2-9116-77fbd0db9d3e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.123531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.124172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.124455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.124729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.135663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.137126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:47.158122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:47.159076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:47.159958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:47.160823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 296/607] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:47.170751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.255752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29dfbe-5d5c-41f9-a7e6-1efb7521b074 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.316858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.317510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.318090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.318367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.325727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d3bc6-7832-4fa8-b0bf-bd85df18b5aa None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.344337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:47.349648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:47.350570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:47.352077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 312/608] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:47.358629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.376275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.395531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.396150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.396433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.396710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.397409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:47.397733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.403901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.404282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.429323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 297/609] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:47.442693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.501942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4c574-71f1-4dd5-864c-0d08dba390d2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.546676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.547290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.547570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.547843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.548514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:47.548816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.550205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.566718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 313/610] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:47.574612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.642568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217f0f-7594-436f-9c87-63a4f2e1c0e0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.712220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8389278-a4ef-44ad-aab2-5e5391bed6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.712889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389278-a4ef-44ad-aab2-5e5391bed6f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.713172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389278-a4ef-44ad-aab2-5e5391bed6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.713446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8389278-a4ef-44ad-aab2-5e5391bed6f6 None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/2e45f572e4d94afc98c4a68b11ab4b36/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.742671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.742910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389278-a4ef-44ad-aab2-5e5391bed6f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=2e45f572e4d94afc98c4a68b11ab4b36, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.744406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8389278-a4ef-44ad-aab2-5e5391bed6f6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.768891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 298/611] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:47 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/2e45f572e4d94afc98c4a68b11ab4b36/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:47.772623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf54eb-1760-4440-a2af-52570016fab5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:47.810695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:47.811345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.811630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.811907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.824044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:47.825508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:47.837455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d06a2-3474-4c8c-8ffb-6e0dd1c69e0d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.837838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d06a2-3474-4c8c-8ffb-6e0dd1c69e0d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.838122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d06a2-3474-4c8c-8ffb-6e0dd1c69e0d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.839917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 299/612] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-e89ecb87-da15-495d-be67-35e9de0df594 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:47.845988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:47.846990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:47.848291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:47.848291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:47.848291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:47.848291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 314/613] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:47.854062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d06a2-3474-4c8c-8ffb-6e0dd1c69e0d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:47.865681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:47.868890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:47.869186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:47.910185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:47.911296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:47.913076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:47.993291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d06a2-3474-4c8c-8ffb-6e0dd1c69e0d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.033916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 315/614] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:48.042462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.043331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.043748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.044189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.045027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:48.045481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.047043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.061599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 300/615] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:48.066916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.156720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:48.205596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd2458-88da-4e24-aefe-09e7b8844192 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.260372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.261383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.261897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.262403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.276049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.277841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:48.294103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:48.295059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:02:48.296020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:48.298238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 316/616] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:48.303904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.433829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:48.439627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.446340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6717db2-8e4b-4cac-a7c3-8e66dde7bf0c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.527240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.527779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.528062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.528335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.529080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:48.529386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.530842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.564172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 301/617] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:48.569041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.629794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e3bf1-846b-44b6-8939-82240220dcaf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.673460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:48.694565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.695319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.695628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.695897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.715429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:48.720649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:48.721602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:48.722466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:48.723088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 317/618] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:48.729832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.754253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ce7da-f09f-46e8-8ce9-673e6aa4ee76 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.811142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.811684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.811965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.812238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.829192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.830682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:48.856465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:48.857432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:48.858518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:48.858518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:48.858518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:48.866518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 302/619] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:48.870888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:48.876673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:48.912030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac36df6-728e-4ea3-ac87-6d5dcc1a4ea7 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:48.969109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:48.969875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.970166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.970450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.971117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:48.971432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:48.972804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0f814-6ce3-454e-aa75-9d883b76677b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:48.989771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 318/620] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:48.989771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e99f7-9942-4df2-9f72-be96e44fe552 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.989771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e99f7-9942-4df2-9f72-be96e44fe552 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.989771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e99f7-9942-4df2-9f72-be96e44fe552 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:48.989771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 319/621] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:48.991581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca5bfb-6ae7-45d7-99f1-3a20a6c258e1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:48.991915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca5bfb-6ae7-45d7-99f1-3a20a6c258e1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:48.992196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca5bfb-6ae7-45d7-99f1-3a20a6c258e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.012716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-deca5bfb-6ae7-45d7-99f1-3a20a6c258e1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:49.013656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99972fc2-1d07-4f5f-94fc-43928d661f46 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.013970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-deca5bfb-6ae7-45d7-99f1-3a20a6c258e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:49.050001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.050620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.050907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.051187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.051842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:49.052157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.053544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.073027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.073942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 303/622] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:49.074817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.105658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 320/623] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:49.106947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b471270-353a-4847-989b-9939ee55d3c2 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.107235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b471270-353a-4847-989b-9939ee55d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.107511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b471270-353a-4847-989b-9939ee55d3c2 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.108947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 321/624] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:49.109447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b471270-353a-4847-989b-9939ee55d3c2 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.164816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.207718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e9db1d-3501-4737-a163-0e4839b64838 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.238011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b471270-353a-4847-989b-9939ee55d3c2 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.245497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.246206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.246487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.246789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.259757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.261370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-204f95d5-8905-489b-b92f-2ff91ce45181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:49.277322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:49.278565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:49.279857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:49.279857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:49.279857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:49.279857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 304/625] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:49.280131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.280302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.280819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.286071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.286883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.287486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.287925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.297160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.299033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.301174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:49.302451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:49.313310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:49.314434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:49.315537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:49.317907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 322/626] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:49.318954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.367872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.381028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 305/627] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:49.383503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.441858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.449886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93672a4c-c7b4-44f5-8e2e-96d90caa91d2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.504007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.505915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.506412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.506917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.508096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e884ba4-ca32-42f1-a1ac-d3fbc7b419ed None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.508523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:49.509171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.511958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.528323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 323/628] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:49.529563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.549275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.550404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.551306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.551889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.552977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:49.553755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.556581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.574791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 306/629] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:49.575965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.655801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.665225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6819cf51-e3e8-4057-be2e-b24be9611022 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.687565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f749bf-a87b-429b-af33-79c6cfe890ce None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.692155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.702895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.703520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.703802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.704074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.716061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:49.721724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:49.722642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:49.723470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 324/630] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:49.724170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.732208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.732847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.733132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.733408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.741238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.742749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:49.755041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:49.755988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 30 00:02:49.756903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:49.760928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 307/631] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:49.761924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.831963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b821958-1677-4624-9170-8a0be93d58fd None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.871124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba3147-639a-4862-a9b2-56d8e6d5f722 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:49.872027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.872691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.872974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.873249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/5be0312450644dd69a7c7263e347b28b/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.890758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=5be0312450644dd69a7c7263e347b28b, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:49.892513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:49.905880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 325/632] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:02:49 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/5be0312450644dd69a7c7263e347b28b/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:02:49.907033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.920934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:49.921602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:49.921917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:49.922190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:49.934906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:49.936044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:49.941613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:49.942631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:49.943571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 308/633] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:49.944275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:49.973440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.047351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de442d7-c02d-47cf-8256-73c659d3f02a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.068851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d8ce5-836d-4ef2-a106-faebc3c7033e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.089363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.090008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.090308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.090568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.091786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:50.092096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.094006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2180ef-e6d8-419e-abe1-7898e17f97b7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.107544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 326/634] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:50.107544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc37b1-a5e5-4ee3-8281-1e259f9e1389 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.107544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc37b1-a5e5-4ee3-8281-1e259f9e1389 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.107544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc37b1-a5e5-4ee3-8281-1e259f9e1389 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.107544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 327/635] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:50.108207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc37b1-a5e5-4ee3-8281-1e259f9e1389 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.114669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.115290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.115573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.115848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.116590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:50.117753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.119055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20567a26-93b5-4bdf-821c-3b13a6436f0e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.144205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 309/636] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 00:02:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:50.145430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.145749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.146022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.165080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:50.166227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:50.188852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.227978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc37b1-a5e5-4ee3-8281-1e259f9e1389 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.242466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 310/637] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:50.242466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.256223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.281226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.281440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.281626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.281923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.282585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:50.282885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.284353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.294427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 328/638] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:50.295602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.358378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf75a7-e9b9-4425-802d-0ca446985a9a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.396692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.397648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.398783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.399258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.410578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.412216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.424645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879398b8-68b4-4ca7-8a68-c73cf821540f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:50.429306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:50.430544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:50.431535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:50.431535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:50.431535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:50.437844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 311/639] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:50.438989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.457939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.465949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.466469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.466751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.467020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.512948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.549655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.551173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.556528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622508d-8f37-4f82-9e4b-e9298e621d06 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.591290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.591914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.592201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.592481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.604849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.606329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:50.620399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:50.621310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:50.622543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:50.622543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:50.622543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:50.622543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 312/640] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:50.622543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.674052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 329/641] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:50.674052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.702998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.731299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a03c7-9fa6-4f5c-97bc-b797de33ddd9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.747889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:50.768569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.769178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.769550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.769859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.770605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:50.770810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.772191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.779133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9907-4a8d-48f9-b609-f80b2caa43c0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.785185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 313/642] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:50.785874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.826060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.827915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.828422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.828894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.843466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:50.850057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:50.851028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:50.851893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:50.859899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 330/643] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:50.861300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.927177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e437be-35aa-442f-922e-6cb701464e5a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:50.966437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:50.967047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:50.967430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:50.967768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:50.968525 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:50.968897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:50.970507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:50.984780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 314/644] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:50.985496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:50.998600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.015204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67740692-5f8e-4fb3-a35a-8a0d130a7775 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.036965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.055182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.056189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.056711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.057002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.075494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.076956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:51.091920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:51.092847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:51.093916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:51.093916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:51.093916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:51.093916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 331/645] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:51.093916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.134232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301c579-4bc9-4ae1-bb80-0c8e19fff8df None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.175204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.176168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.176656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.177724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.188781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.190279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:51.202705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:51.203646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:02:51.204586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:51.208552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 315/646] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:51.209543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.226716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722129c1-480e-4f18-87ee-ba406961f885 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.272273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.273080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.273334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.273881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.274614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:51.274919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.276268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.289287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 332/647] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:51.289287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.293961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.322656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.329641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650334b3-d79f-4752-9d84-d2ad9dd4f0f2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.365221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.365888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.366183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.366462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.375965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.377430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:51.394396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:51.395704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:51.396920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:51.400755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 316/648] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:51.402126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.408973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93dcb6-0eab-45d5-be0e-1750c9b7d604 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.446877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.447496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.447780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.448255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.448671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:51.448978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.450359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.462652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 333/649] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:51.463629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.514631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3245a8-ca19-4d12-849a-5a014efb140a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.527600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.554919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.555889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.556175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.556452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.557187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:51.557495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.558960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.575109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2edd03-6127-46b7-b7ef-a22f1322bd42 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.578012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 317/650] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:51.578857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.599269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.619081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.619714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.619997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.620266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.631218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.632429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:51.647790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:51.649677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:51.650820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:51.650820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:51.650820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:51.653953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 334/651] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:51.654813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.696717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a717b6-fc84-4bab-89ee-1e3f36365c57 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.735634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.736362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.736642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.736913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.737649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:51.738106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.739548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.763377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 318/652] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:51.763377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.768395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30299792-4713-451e-b89e-7b515db96df1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.785287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.805863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.806499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.806784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.807057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.813926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.815357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:51.827661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:51.828747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:51.829631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 335/653] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:51.830161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:51.842312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:51.873234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e99c4-7eba-4dea-82ef-67c594420f2f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.908023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.908690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.909006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.909285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.934320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0620df-93c6-4f1d-b001-6b1e6b240dbb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:51.967805 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:51.968407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:51.968690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:51.968966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:51.969605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:51.969934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.971282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.981689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:51.982717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 336/654] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:51.983186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:51.983511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.017687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.057807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.083514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5724-be1a-4356-8870-517830eaadd0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.089191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 319/655] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:52.090052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.121027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.121631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.121943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.122224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.187242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df22075-939c-4c01-9d96-dabe89033050 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.189335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.190834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.220317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.220914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.221204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.221484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.222208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:52.222517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.223938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ecdcfe-4e0f-4e49-9741-dc7a850cfe30 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.225326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.236141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 320/656] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:52.237329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b13684-9910-49b2-bcbd-35fd032b16d1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.237619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b13684-9910-49b2-bcbd-35fd032b16d1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.237928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b13684-9910-49b2-bcbd-35fd032b16d1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.241753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 321/657] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:52.241753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b13684-9910-49b2-bcbd-35fd032b16d1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.271355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.297350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 337/658] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:52.298213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.347178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b13684-9910-49b2-bcbd-35fd032b16d1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.380641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.381263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.381545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.381944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.389220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.390701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.397034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2f8a0-a5cf-44f9-9183-27ac8529d1dc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:52.401797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:52.402890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 322/659] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:52.403845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.432684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.433315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.433599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.433918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.436535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.444564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.446074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-bcf989a6-f4b5-4e0e-a3d5-81d36432d537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:52.461515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:52.462654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:52.463506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:52.463506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:52.463506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:52.463506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 338/660] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:52.463854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.464154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.464397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.484965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:52.486243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:52.502142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.511788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94bfbd-98c4-46f7-86b7-0d9056ce01d6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.546129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.546722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.547001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.547295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.548006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=274f72b3a3c34d6388ff820627f2f4cc) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:52.548310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.549740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.553554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 339/661] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:52.555022 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.557164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 323/662] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/role_assignments?user.id=274f72b3a3c34d6388ff820627f2f4cc&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:52.558099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.674452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf712bfb-80ec-4c15-92b4-0983f483f8e1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.685344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18193ce-7a3f-4f28-a343-0b6f8ca98bab None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.706689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.715635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.716250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.716537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.716814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.717555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:52.717896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.719327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.727554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.728183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.728555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.728735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.740752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 324/663] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:52.740920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.742379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.743100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.762089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:52.766080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:52.766990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:52.768493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:52.768493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:52.768493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:52.768493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 340/664] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:52.768493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.878998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9a27-01ed-4ab5-a655-1553cf04b724 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.901873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b47783-0876-450f-bc15-26a170e73327 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:52.919938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.920973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.921272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.921552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.922391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:52.922704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:52.924089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:52.937770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 325/665] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:52.938538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:52.946887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:52.947581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:52.947933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:52.948294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:52.989250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.021393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.022875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.023707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.049488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a1954-7d01-4542-a69f-3f90b8fa2fd5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.086842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.087452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.087737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.088017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.088662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:53.088967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.090378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.108649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 326/666] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:53.108649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.135666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 341/667] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:53.136751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.213571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.218748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713fa69e-704e-411b-b0f1-8c96601f8947 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.248671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d750bd-fe42-4154-bede-446ef46a2d5e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.258259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.258947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.259231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.259743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.261516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.272765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:53.277802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:53.278724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 327/668] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:53.279572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.291835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.292478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.292763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.293041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.300401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.301864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:53.314418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:53.315482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 342/669] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:53.316376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.394596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dea589-321d-4cfd-b322-4641fdb1ea17 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.423585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ed835-6d98-4ecf-9dfc-369a047afd9b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.431537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.432304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.432682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.433048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.440589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.442161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.453788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:53.454014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:53.455069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 328/670] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:53.455951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.467216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.467872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.468228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.468571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.480528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.482088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:53.497072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:53.498221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:53.499297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:53.499297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:53.499297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:53.500965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 343/671] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:53.503072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.517507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.568686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16379984-f42b-4f18-9360-14f2af94f492 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.604923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.605546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.605863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.606137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.606793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:53.607096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.608465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.611281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f008c-fd5a-4d45-86fb-1312ed5f2d83 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.621748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 329/672] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:53.621748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.651060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.651810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.652230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.652579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.653347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:53.653806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.655413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.669083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 344/673] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:53.670050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.718694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.729517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2a401-a4ec-447b-b95e-b30ed3565c3b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.750152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.773313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.774076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.774690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.774690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.775439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:53.775772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.777210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.785235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8b0a6-d152-4d46-9d0e-906fdea8ab66 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.795974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 330/674] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:53.795974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.825586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.826301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.826667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.827043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.827789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:53.828194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.829638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.845533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 345/675] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:53.850708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:53.898603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de4e4cf-023b-4625-b9b5-021c46dbb02a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.941238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:53.942013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:53.942191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:53.942459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:53.952781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:53.954272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:53.961343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f766d-ee4f-4936-8c61-59ff7aca842d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:53.962906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:53.972121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:53.973018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:53.974168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:53.974168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:53.974168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:53.974168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 331/676] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:53.974168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.007179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.007784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.008069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.008341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.008693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:54.009059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=0f458d5fcb964638be06e1bf21869250) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:54.009373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.010856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.017052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 346/677] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/role_assignments?user.id=0f458d5fcb964638be06e1bf21869250&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:54.017874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.121891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4522f8d-0a0a-4605-9dd1-54057156fa30 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.162582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.165202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.165202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.165202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.165614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=118462014bfa41e388b6bb0be1d208d0) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:54.165945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.168827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ba263-bb2b-400d-861d-02ffd6bb0a46 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.169580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.174499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 332/678] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:53 2022] GET /identity/v3/role_assignments?user.id=118462014bfa41e388b6bb0be1d208d0&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:54.175442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.215942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.216837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.217131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.217408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.225794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.227976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:54.244337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:54.246843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:54.248668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 347/679] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:54.254275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.300209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:54.310382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:54.325439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bae343-e4f0-4844-834b-4634f9c27153 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.376624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.378029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.378330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.378610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.379268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:54.379841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.381605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.399425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 333/680] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:54.404652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.417499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee4569-d6c8-4b95-9d7d-b8ff738dd456 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.462329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.463511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.464456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.465279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.467162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:54.467687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.469588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.488059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 348/681] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:54.494138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.533621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84781-5249-4cd4-a9b3-20c025f91b73 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.580206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.580855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.581122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.581399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.591182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.592666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:54.605667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:54.606657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:54.607566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 334/682] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:54.612268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.620173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:54.631545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:54.642424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4269f47b-994e-49f9-88b6-7a0575e54c75 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.684725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.685358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.685641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.685945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.687067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=2e45f572e4d94afc98c4a68b11ab4b36) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:54.687197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.688564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159c21cd-6bb9-41f3-8c53-38b27e3425f8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.696261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 349/683] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/role_assignments?user.id=2e45f572e4d94afc98c4a68b11ab4b36&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:54.699424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49aabc-6f8a-404c-8c1a-ee97e9d5aa57 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.699711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49aabc-6f8a-404c-8c1a-ee97e9d5aa57 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.699989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe49aabc-6f8a-404c-8c1a-ee97e9d5aa57 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.701341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 350/684] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:02:54.708293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.708578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.708985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.734735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:54.736095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:54.754729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6023321-8591-4568-be26-c0df065c54dd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.805223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.806425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.806951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.807440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:54.808421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:54.808941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:54.810705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:54.835000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 335/685] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:54.841085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:54.843989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 351/686] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 30 00:02:54.926658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:54.958901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e118afd-bd47-4cf8-a15c-cc082e3a03bc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:54.994951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:54.995574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:54.995863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:54.996141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.069279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.071474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.143160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:55.178679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 336/687] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:55.184207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.229643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.332983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54764819-2db3-4777-b587-b8267d4bbeef None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:55.354693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:55.369979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:55.370613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.370891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.371163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.400238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870be4d-245b-4ac0-9ad9-f4ea0575a89f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:55.402488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.403951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:55.428569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:55.429574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:55.430655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:55.430655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:55.430655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:55.443916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 337/688] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:55.445947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.469127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:55.469792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.470072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.470343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.483417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.484867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:55.502855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:55.505303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:55.508109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:55.508109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:55.508109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:55.508109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 352/689] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:55.511448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.515301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:55.626289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ea41b-ed22-4409-8ddf-58b2d95e7c36 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:55.665969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:55.667369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.667673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.667951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.668597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:55.668951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.670383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.684735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 353/690] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:55.685287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:55.690429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.784055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a932198-45d7-4f65-8a1c-849452624ae8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:55.837071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e60a-462c-4001-bdba-5a143be43259 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:55.859268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:55.859882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.860168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.860443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.861097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:55.861402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.862801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.888606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 338/691] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:55.893496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:55.904846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:55.905941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:55.906224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:55.906500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:55.923118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:55.927691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:55.949252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:55.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:55.953488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:55.957746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 354/692] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:55.978055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:56.059300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:56.072911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:56.082489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd1aacf-9845-46d7-972f-9c58e3b3b7d5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:56.120844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:56.121454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.121753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.122030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.122803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:56.124254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:56.154090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 339/693] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:02:55 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:02:56.173422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e15c-38d2-41dc-94fe-f0b78ccfb3e5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:56.214325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:56.215105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.215294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.215447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.216168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:56.216527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:56.218134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0374d9-ab3a-4d10-b59b-6d5c1fb990a7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:56.233256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 355/694] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:56.239414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:56.363007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac626a-5a11-4090-961f-b26b268a092b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:56.400919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:56.401532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.401833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.402107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.402833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=5be0312450644dd69a7c7263e347b28b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:56.403139 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:56.404632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e4603b-ddcf-415c-9ceb-16f749d55ec6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:56.410958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 340/695] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:56 2022] GET /identity/v3/role_assignments?user.id=5be0312450644dd69a7c7263e347b28b&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:56.485676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba96e-4a2c-46c0-83e9-6d5de98d6865 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.485676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba96e-4a2c-46c0-83e9-6d5de98d6865 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.485676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba96e-4a2c-46c0-83e9-6d5de98d6865 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.485676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 356/696] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:56.497020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472d39a-5f65-4942-8785-f3e4d0ff212b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.497020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472d39a-5f65-4942-8785-f3e4d0ff212b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.497020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472d39a-5f65-4942-8785-f3e4d0ff212b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.501466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:56.517904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d472d39a-5f65-4942-8785-f3e4d0ff212b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:56.519502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d472d39a-5f65-4942-8785-f3e4d0ff212b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.602637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 341/697] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:56.769190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74971af9-1843-4270-96cb-543438298ae4 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.769484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74971af9-1843-4270-96cb-543438298ae4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.769665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74971af9-1843-4270-96cb-543438298ae4 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.771330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 357/698] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:56.776703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:56.777000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:56.777278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:56.806741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:56.807961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:56.887032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74971af9-1843-4270-96cb-543438298ae4 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:56.898263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 342/699] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:57.000814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74971af9-1843-4270-96cb-543438298ae4 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.023370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:57.054779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.055815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.056300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.056785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.057582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.059314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:57.072536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:57.073567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:02:57.074440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:57.077201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 358/700] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Aug 30 00:02:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:57.083157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.161092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:57.212057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b048a-f31c-476f-a0a9-0d371ff45cf1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.238748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.247271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.247889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.248170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.248443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.249078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:57.249490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.251032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.256541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 343/701] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:57.262948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.390003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c7c5bb-7f1c-4a2a-9d42-488a48b92322 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.418338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4ccfb6-cdc6-4676-9063-51753c1d9da5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.430278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5d590-2219-4424-b281-248b9df5df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.431200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5d590-2219-4424-b281-248b9df5df18 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.431490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5d590-2219-4424-b281-248b9df5df18 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.431770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5d590-2219-4424-b281-248b9df5df18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.446025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:57.447534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5d590-2219-4424-b281-248b9df5df18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-4fb5d590-2219-4424-b281-248b9df5df18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:57.455125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:57.456040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:57.456861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:57.457571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.457659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 359/702] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:57.458337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.458337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.458337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.458674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26941c5-3ee7-4ee4-b21a-9a5f0c822ba1 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.458784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:57.458974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26941c5-3ee7-4ee4-b21a-9a5f0c822ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.458974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26941c5-3ee7-4ee4-b21a-9a5f0c822ba1 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.463247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.463974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 360/703] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:57.465251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.465468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.465617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.465824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.472465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 344/704] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:57.473513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.491168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:57.493253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:57.533916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:57.581900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 361/705] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:57.598578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b42bf-f3fe-4a7b-bdaa-6eeb04f8eda2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.637918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.638549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.638836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.639114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.639792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:57.640158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.641478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.650913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 345/706] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:57.656904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.785447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6d642-04f3-40f0-aaab-2a2bce2d4c7a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:57.829691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:57.830361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:57.830645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:57.830920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:57.842045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:57.843498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:57.865315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:57.866333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:57.868247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:57.868247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:57.868247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:57.868247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 362/707] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:57.874507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.909465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:57.947632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:57.973322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.052610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ce60d-bde8-4c7d-9872-83593d0baea1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.089357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.090191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.090597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.090975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.091812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:58.092239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.093723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.107794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3f6db-95b5-4dda-b0a7-88794a21cf81 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.110643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 346/708] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:58.112758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.216052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8745-9fde-44f9-b16c-9c37b3d89dd7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.219889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.220726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.221200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.221614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.222369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.223869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.234114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:58.247410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:58.248990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:02:58.250071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:58.259432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 363/709] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:57 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:58.260901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.261545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.261917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.262204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.267084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.283957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.285438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:02:58.309544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:58.310596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:02:58.311501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:58.315426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 347/710] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:58.316612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.421899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a927799c-ab1c-4c62-980a-ef692b7d3d7b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.457359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.458011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.458297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.458576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.459316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:58.459627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.461210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.484861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 348/711] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:58.486082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.494835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.519221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.552422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85d6ee-4e1d-4769-afd4-87eac2677fc0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.597292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a2328-9ddb-4bbc-a221-31249300d441 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.635385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.636007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.636290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.636561 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.691943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.692563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.692839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.693103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.693772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] RBAC: Adding query filter params (name=network) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:58.694079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.695477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.707324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.708799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.719731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 364/712] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:02:58.738821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.774129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.831464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 349/713] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:02:58.832863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:58.938436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b352d-2bb5-4ad5-b51a-bf369759bd89 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.943315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200bf94-651d-4e98-bbd5-1918891aeb3a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:58.975437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.976735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.977127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:58.977699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.978104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.978800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] RBAC: Adding query filter params (type=network) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:58.979177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:58.980733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534445d0-d12c-4af6-8e88-ec9ddb49b1bc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:58.985252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:58.986189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.986606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 365/714] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:58.986877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.987332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.987962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613f38-66a5-4a12-9dc0-1fe1fd1c95f2 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.988253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613f38-66a5-4a12-9dc0-1fe1fd1c95f2 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.988531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9613f38-66a5-4a12-9dc0-1fe1fd1c95f2 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.994446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 366/715] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:58.994446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123841-a587-4f90-9675-6c56295e8bf6 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:58.994446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123841-a587-4f90-9675-6c56295e8bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:58.994446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c123841-a587-4f90-9675-6c56295e8bf6 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:58.998802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 367/716] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:59.000258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.000618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.000903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.009221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.011131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.021920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:59.023855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:59.027261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2d0db035-988e-47b8-8c04-ed93638e14c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:02:59.030117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:59.031587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:02:59.032700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:02:59.032700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:02:59.032700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:59.034606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 350/717] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:02:59.036027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.036449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.036855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.057655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:02:59.059320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:02:59.117733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 368/718] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:59.117733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.168338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 351/719] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:02:59.238681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57690d8-d2f3-4eab-bba2-7d9f2f65695b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.278137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.278763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.279009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.279216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.279864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:59.280169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.281534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.290997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.299908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 369/720] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:59.301366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.415315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95666984-40c6-42ad-9059-812171cdaec0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.429572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.452195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.452835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.453120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.453395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.461529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.470990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.474480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:02:59.490335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:59.491313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:02:59.492361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:59.494897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 352/721] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:59.495924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.605999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19085052-4c58-4f98-b417-5bc08255f56c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.609571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16474d-998e-424c-b41a-2a882296abaf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.642103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840aba0-17de-4140-bd58-71658852990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.643154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aba0-17de-4140-bd58-71658852990c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.643659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aba0-17de-4140-bd58-71658852990c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.644130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840aba0-17de-4140-bd58-71658852990c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.654894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.655522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.655804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.656074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.659228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840aba0-17de-4140-bd58-71658852990c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c840aba0-17de-4140-bd58-71658852990c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:59.665961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:59.666913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:02:59.667742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:02:59.671955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 353/722] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:59.672785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840aba0-17de-4140-bd58-71658852990c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.674650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:02:59.682153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:02:59.683158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:02:59.684065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:02:59.688006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 370/723] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:02:59.689247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.725461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.777295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.806721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840aba0-17de-4140-bd58-71658852990c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.837620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03075e-0070-4cf6-b1f0-386eb2a58cc1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:02:59.852831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.853449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.853763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.854048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.854750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:59.855062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.856569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.869868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 354/724] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:59.869868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.877026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:02:59.877646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.877976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.878254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.878926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:02:59.879232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:02:59.880871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5534502e-9f2d-4449-a8d1-5421a2e93594 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:02:59.893885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 371/725] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:02:59.895321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcfd2c-729a-44e6-b60d-7e3e0c013f77 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:02:59.895621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcfd2c-729a-44e6-b60d-7e3e0c013f77 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:02:59.895902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcfd2c-729a-44e6-b60d-7e3e0c013f77 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:02:59.897148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 372/726] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:02:59.898587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcfd2c-729a-44e6-b60d-7e3e0c013f77 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:02:59.983978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:02:59.995426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d316d58-953a-4eba-b950-286d18f79b57 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.014461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcfd2c-729a-44e6-b60d-7e3e0c013f77 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.035444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.036050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.036329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.036599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.037256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:00.037556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.038177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:00.039852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.052346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 355/727] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:00.052346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.055718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.056405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.056683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.056955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.057686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=118462014bfa41e388b6bb0be1d208d0) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:00.058026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.059479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf80e43e-e824-42df-9e08-b4147730841a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.065647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 373/728] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:02:59 2022] GET /identity/v3/role_assignments?user.id=118462014bfa41e388b6bb0be1d208d0&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:00.066811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.067095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.067370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.091878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:00.093132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:00.184703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb0c4b-0ff2-45b7-a1b5-3622d2e9cf5a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.194159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 374/729] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:03:00.196329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.248808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.251108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.251623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.252229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.268704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.270709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:00.292398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:00.293366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:00.294312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:00.294312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:00.294312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:00.295023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 356/730] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:00.301154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.314780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:00.343444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df95bee1-2f8e-4632-ad47-5450b5719bac None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.363305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:00.387585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.389015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.393645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.394157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.411231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.415224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:00.441886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:00.442851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:00.443729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:00.443729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:00.443729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:00.445006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 375/731] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:00.453267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.517929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8825b4-54ee-466e-8318-dc6c466e4c95 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.559886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.561282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.561566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.561874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.562530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:00.562835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.564376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.581815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 357/732] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:00.582691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.603002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23681f3-e3e9-44e1-9373-8c32614ec990 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.649626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.650682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.650963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.651508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.652161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:00.652715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.654777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.660267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:00.677093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 376/733] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:00.678688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.704961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0b4b9-464d-4d11-b212-04ea7617244a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.721633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:00.744620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.745228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.745511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.745815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.746590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.748070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:00.775095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 358/734] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:00 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:00.775095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:00.861375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b9151-1c5a-46ae-9c94-8ab426778947 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.961827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d0b4d-5812-48a5-b5e6-555e46ceea6a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:00.973364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:00.974055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:00.976412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:00.976809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:00.990115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:00.992136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.003860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:01.016050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:01.017126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:01.018518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 377/735] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:01.023435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:01.024086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.024473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.024674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.026152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:01.037977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:01.039910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:01.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:01.057356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:01.058341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:01.060842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 359/736] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:03:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:01.070695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:01.132155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.171705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4efce-3571-41a7-a2e4-3e53bacc7acd None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:01.207702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86a236-fe9b-474a-a801-b0fad20ecbe8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:01.249920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:01.250633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:01.251859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.252512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.253006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.253975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.254701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.255041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.256050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:01.257550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:01.258092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:01.259485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:01.261227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.262114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.301689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 360/737] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:01.303634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 378/738] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:01.309096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:01.310458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:01.373549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.447929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e11940-4cb0-4471-ab0d-6823a37c1967 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:01.455449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c6c241-df90-449b-8c50-dc086aa1ee5a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:01.486229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f533a96-0ef8-4b56-8866-d83234928e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:01.487082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533a96-0ef8-4b56-8866-d83234928e03 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.487467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533a96-0ef8-4b56-8866-d83234928e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.487842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533a96-0ef8-4b56-8866-d83234928e03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.501825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001014e8-6357-4355-a168-999f8bae9077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:01.502921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001014e8-6357-4355-a168-999f8bae9077 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.503350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001014e8-6357-4355-a168-999f8bae9077 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.503766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001014e8-6357-4355-a168-999f8bae9077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.521304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.588874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f533a96-0ef8-4b56-8866-d83234928e03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:01.590852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001014e8-6357-4355-a168-999f8bae9077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:01.591609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f533a96-0ef8-4b56-8866-d83234928e03 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.592483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001014e8-6357-4355-a168-999f8bae9077 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.638852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.704466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 361/739] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:01.705968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ac2c-f299-4d2a-9ea6-64d76d80619c None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.706377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ac2c-f299-4d2a-9ea6-64d76d80619c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.706755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ac2c-f299-4d2a-9ea6-64d76d80619c None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.712137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 362/740] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:01.712137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ac2c-f299-4d2a-9ea6-64d76d80619c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:01.732244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 379/741] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 30 00:03:01.738293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.738690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.739070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.758784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:01.760042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:01.799428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.841743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 380/742] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 30 00:03:01.841743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:01.845894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ac2c-f299-4d2a-9ea6-64d76d80619c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:01.929794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:01.929794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:01.929794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:01.929794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:01.948010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:01.952136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9569ae4c-53a3-471e-9e2a-be8372564152 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:01.953615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:01.955138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:01.987816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:01.988825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:01.990433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:01.990433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:01.990433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:01.994247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 363/743] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:01.995512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.025633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.026214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.026693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.026972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.039685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.041198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:02.057847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:02.058795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:02.060070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:02.060070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:02.060070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:02.060070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 381/744] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:02.064774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.098205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.176628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eaeda9-32d9-4c7d-86b9-aeb128edff17 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.203177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e215dd1-be75-4b0b-9804-c644791a8a94 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.213020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.213626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.214248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.214531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.215353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:02.215659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.217060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042603c1-5914-45d5-92ec-d4c59fca8aa5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.233499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 382/745] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:02.233499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e3bd-fd29-4e52-8a02-2b137ab603dd None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.233499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e3bd-fd29-4e52-8a02-2b137ab603dd None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.233499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a318e3bd-fd29-4e52-8a02-2b137ab603dd None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.233499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 383/746] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:02.233499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e3bd-fd29-4e52-8a02-2b137ab603dd None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.245499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.246369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.246552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.246867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.247535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:02.247831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.249374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.266811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 364/747] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:02.267677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.321295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.324766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.339690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a318e3bd-fd29-4e52-8a02-2b137ab603dd None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.380016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a6ff8-68bf-454f-b9d3-5ba635fd1b08 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.380630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8d782-6d04-42c5-a8b9-b224d48264d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.381244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8d782-6d04-42c5-a8b9-b224d48264d9 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.381536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8d782-6d04-42c5-a8b9-b224d48264d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.381836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8d782-6d04-42c5-a8b9-b224d48264d9 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.382502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8d782-6d04-42c5-a8b9-b224d48264d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.383864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d8d782-6d04-42c5-a8b9-b224d48264d9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.400830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 384/748] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:02 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:02.401960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.402202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.402471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.421934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:02.423172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:02.436026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.437092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.437614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.438144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.447001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.448821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:02.463795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:02.464760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:02.465629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:02.468374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 365/749] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:02.469621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.506141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 385/750] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:02.507199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.615006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90867b-8a78-4625-a8e0-0404a65b2bf8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.620941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.652125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.655259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.656610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.657010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.658459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.670853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.673358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.687205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580845eb-939f-4dcf-ac42-8319829479f7 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:02.692885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:02.693957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:02.695061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:02.697868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 366/751] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:02.703829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.728650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.729289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.729751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.730189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.730914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:02.731323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.733202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.749741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 386/752] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:02.753536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.832805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389be01-8a67-472c-8290-664f0a4e3339 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.869936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.870418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.870690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.870961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.871776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:02.872096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.873887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.888595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 367/753] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:02.889242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:02.896001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792fec4-85f7-4056-8b6f-525d464d1bf9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:02.935278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.942923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:02.943540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:02.943826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:02.944100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:02.945368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=5be0312450644dd69a7c7263e347b28b) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:02.945857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:02.948047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:02.949672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:02.957885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 387/754] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/role_assignments?user.id=5be0312450644dd69a7c7263e347b28b&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:02.957885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.040986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875d3f-0ed3-499d-baf4-a9089f750945 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.081168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10625cf9-14d8-49d6-a1f9-8a0bba5fc155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.081840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625cf9-14d8-49d6-a1f9-8a0bba5fc155 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.082122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625cf9-14d8-49d6-a1f9-8a0bba5fc155 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.082392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10625cf9-14d8-49d6-a1f9-8a0bba5fc155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.095914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10625cf9-14d8-49d6-a1f9-8a0bba5fc155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:03.099187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb94cfe-08b4-4e8e-8b4a-ddddd322f734 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-10625cf9-14d8-49d6-a1f9-8a0bba5fc155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:03.102510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:03.103469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:03.104287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 368/755] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:03.105373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e1153-e186-46c7-ad3e-fbad5868c566 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.105645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e1153-e186-46c7-ad3e-fbad5868c566 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.105945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15e1153-e186-46c7-ad3e-fbad5868c566 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.107207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 369/756] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:03.112734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.113019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.113299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.135718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:03.136939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:03.146019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.146948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.147462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.147989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.149415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=6896402969554f88ae946f35aed55bc5) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:03.150413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:03.152420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:03.160550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 388/757] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:02 2022] GET /identity/v3/role_assignments?user.id=6896402969554f88ae946f35aed55bc5&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:03.161692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.214591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 370/758] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:03.245185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:03.301742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0ea8e-0a0e-4c74-acd0-cef214999609 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.342132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.342800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.343086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.343362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.344041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:03.344349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:03.345747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:03.356136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 389/759] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:03.361922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.399740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:03.519177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae14c82-4573-41b5-95c6-4d7be046563b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.541746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.569063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.570268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.570556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.570836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.594261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:03.595745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:03.627905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:03.629280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:03.631181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:03.631181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:03.631181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:03.631181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 371/760] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:03.636345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.745384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8d596-f5bb-42b6-a733-a1786ce12bc3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.770119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:03.773107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:03.793265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.794054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.794317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.794603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.795201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:03.796572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:03.811680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a70e94-f500-4716-ad3a-bfb2ac59722f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:03.813850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:03.814779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:03.815571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 390/761] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:03.826703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:03.855746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:03.856693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:03.857196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:03.857667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:03.858686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:03.859205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:03.860768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:03.874983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 372/762] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:03.882047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.020033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67947c-21e6-41c0-ab19-8b858042581f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.063294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ecd6f5-d780-4078-9797-9468f0656c49 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.079421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.080038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.080325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.080601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.081234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:04.081540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.082945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.092513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 391/763] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:04.098535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.118612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:04.128560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.129199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.129766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.130051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.143366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.145439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:04.172273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:04.173448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:04.174652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:04.175304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 373/764] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:03:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:04.181590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.194267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:04.289306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdd1d9-3835-48d5-812a-92cd8052c64f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.359931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.360548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.360835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.361112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.361777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:04.362089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.363769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.373656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 392/765] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 00:03:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:04.376522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abceb7d-66be-496c-8498-9c5429163847 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.378680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.439266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.439879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.440165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.440442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.445426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:04.445778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.447237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.476926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 374/766] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:03:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:04.482325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.565162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66493b-4034-4a6b-b9c2-6332f9e08ad2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.579377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:04.593682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:04.628927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.629847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.630134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.630413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.631131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] RBAC: Adding query filter params (interface=public, service_id=130b6276c17c4b2b964b6f1c6a7d7839, region_id=RegionOne) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:04.631445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.633721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.649817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 393/767] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:04 2022] GET /identity/v3/endpoints?service_id=130b6276c17c4b2b964b6f1c6a7d7839&interface=public®ion_id=RegionOne => generated 194 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:04.653910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.671908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cfa5f-559e-48be-8ae7-8beed78b8155 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.738424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.739062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.739344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.739618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.758443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.760927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:04.785523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:04.786541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:04.787410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:04.787410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:04.787410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:04.789617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 375/768] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:04.795456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:04.826076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30599c1-45c4-4d34-bd79-2ed4ee1a9a62 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:04.886230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4b345c-73e6-4e00-ba66-0806b469ce25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:04.886854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b345c-73e6-4e00-ba66-0806b469ce25 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.887141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b345c-73e6-4e00-ba66-0806b469ce25 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.887421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b345c-73e6-4e00-ba66-0806b469ce25 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.888035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b345c-73e6-4e00-ba66-0806b469ce25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:04.889395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4b345c-73e6-4e00-ba66-0806b469ce25 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:04.895124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 394/769] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:04 2022] GET /identity/v3/services => generated 772 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:04.896324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056406-09ac-4e71-9c70-8a57655b5982 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.896617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056406-09ac-4e71-9c70-8a57655b5982 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.896899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4056406-09ac-4e71-9c70-8a57655b5982 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.903067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 395/770] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:04.904465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:04.904753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:04.905037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:04.938058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:04.940081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:05.010237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:05.019286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc957e7-0ec3-4e6b-8ce7-2bb4cecc9866 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.026078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:05.064716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 396/771] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:05.079039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.080012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.080303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.080581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.081241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:05.081555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.082987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dd4e2-f0a0-4adc-84b9-a6bbf17b674f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.105268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 376/772] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:05.112856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.245572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced0172-5c68-4c62-9419-8a414cc2673d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.286994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbf250-fe07-450b-afc7-5244568a6547 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.287346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbf250-fe07-450b-afc7-5244568a6547 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.287560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bbf250-fe07-450b-afc7-5244568a6547 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.289362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 377/773] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:05.294255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.294543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.294818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.310037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.310685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.310972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.311250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.320041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:05.321274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:05.323359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.324708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:05.343132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:05.344023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:05.344929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:05.349302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 397/774] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:05.353766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.426011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:05.433317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 378/775] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:05.433317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.514963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833b649-4eab-4490-b95a-9e2ae61cb990 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.537094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:05.552264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4894-b328-481f-ad5b-cead8cf170ab None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.555618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.556144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.556519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.556905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.557719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:05.558181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.559688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d5273-1e2b-4e61-b884-d3a5c89bde78 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.575212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 398/776] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:05.576587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628628-cbb7-43d7-bbef-ef7fad5fa205 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.576974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628628-cbb7-43d7-bbef-ef7fad5fa205 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.577346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44628628-cbb7-43d7-bbef-ef7fad5fa205 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.582994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 399/777] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:05.584232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.584628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.585515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.596424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.597277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.597733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.598658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] PATH_INFO: `/v3/services/network` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.599435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.602108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.605088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:05.606438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:05.615509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:05.616599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:03:05.617409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:05.624035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 379/778] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:05.624035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.702591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 400/779] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:05.704513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.732611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274415bb-e12d-4557-84f5-d688b470c792 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.741049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:05.770961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.771747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.772079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.772358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/118462014bfa41e388b6bb0be1d208d0/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.775124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=118462014bfa41e388b6bb0be1d208d0, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.776677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.794174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 380/780] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:05 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/118462014bfa41e388b6bb0be1d208d0/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:05.794932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.814586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:05.848697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c3297-b46b-430f-abfc-e5aae877e0cd None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.890195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.890805 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.891080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.891346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:05.891979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] RBAC: Adding query filter params (name=network) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:05.892330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:05.893724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:05.899280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 401/781] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:05.909373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:05.940681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a28f6-d337-4b6d-b8ea-a0b1f602f101 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:05.985178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:05.986242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:05.986795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:05.987336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.000137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:06.006285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:06.007795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:06.008611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 381/782] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:06.009307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.071374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.087321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd7786-79ce-44a9-be27-726a9d13cc74 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.106427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.130121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.131131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.131665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.132761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.133794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] RBAC: Adding query filter params (type=network) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:06.134343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.135932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.136052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4feca2-9c26-4e05-8414-23db885a6d70 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.141950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 402/783] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:06.143085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.177948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.178700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.179525 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.179789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.192858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:06.201503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:06.202482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:06.203560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 382/784] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:06.204691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.254374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faababc-ee50-4c44-8775-ba46d859671c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.304744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.306097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.306678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.306961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.307655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:06.307960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.310208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.323328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 403/785] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:06.324641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.330967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57bdbe-165e-4b5a-88d0-04e85abdb218 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.345118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.370991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.371845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.372206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.372537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.373306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] RBAC: Adding query filter params (interface=public, service_id=527a2c4d5ffa436f90007a4a01350293, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:06.373680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.375240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.377418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.388025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 383/786] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/endpoints?service_id=527a2c4d5ffa436f90007a4a01350293&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:06.388924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.469586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b9457-92e9-4871-8914-51355eddf875 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.503342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a03ef3-269a-469d-8e09-9d6c2fb31628 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.516271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.516887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.517172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.517722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.518852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:06.519180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.520811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.532732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 404/787] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:06.533914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.541417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.542906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.543892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.544230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.557443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.559293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:06.576080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:06.577752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:06.578950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:06.578950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:06.578950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:06.578950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 384/788] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:06.578950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.639994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.656765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.683503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2032a63-b26c-4420-80fa-6142df07c4da None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.712527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3c01-bf3a-4173-ab24-9f82bb9f153e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.720895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.721785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.722215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.722637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.723852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.726665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.735904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 405/789] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/services => generated 772 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:06.737588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.783980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.784672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.784939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.785211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.807789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.814252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:06.847542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:06.848556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:06.849469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:06.849469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:06.849469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:06.858281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 385/790] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:06.859673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:06.898030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8bd979-c889-401a-a468-de36e075e8bb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:06.949130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:06.950188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:06.950676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:06.951226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:06.952092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:06.952595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:06.954196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:06.966508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:06.975475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 406/791] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:06.978245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.029962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b8a4fd-ea99-4630-ad2f-62906de85eb5 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.031697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:07.091705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.092328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.092611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.092888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.093770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:07.094085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.095478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.122680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 386/792] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:07.130889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.134306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00b3c4-2012-4b00-b982-13e387dec548 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.174542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.176187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.176187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.176187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.188533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.198091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ea468941-ab1d-4e0c-89c5-dc651847e264 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:07.211411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:07.212413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:07.213341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 407/793] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:07.214153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2b3b-050c-4f14-ad8d-02c07c5e2ea7 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.214382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2b3b-050c-4f14-ad8d-02c07c5e2ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.214651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c2b3b-050c-4f14-ad8d-02c07c5e2ea7 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.221730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 408/794] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:07.221730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2b3b-050c-4f14-ad8d-02c07c5e2ea7 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.273315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3deb3c2-ea36-4df0-b521-07fb8651a28b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.291421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:07.318633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.319265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.320115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.320384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.328352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.329961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2ef7361f-a9d4-473c-8888-8dc67507ed71 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:07.343381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:07.344526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:07.345576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:07.349243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 387/795] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:07.350536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c2b3b-050c-4f14-ad8d-02c07c5e2ea7 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.350730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.351024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.351300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.371373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:07.372723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:07.395975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:07.400169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.401056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.402228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.403111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.404317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:07.404768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.407397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.432156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 409/796] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:07.433273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.477141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 388/797] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:07.477141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.598772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce09c70-8ace-4e4e-8d01-8e4ba7fe14fa None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.638711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:07.648923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27895c56-6972-4846-9b00-746f7a454ae0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.674430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.675079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.675321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.675597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.676337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:07.676647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.678168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.717287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 410/798] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:07.719113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.724075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.724711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.724990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.725262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.741098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.743473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:07.770244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:07.771255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:07.772112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:07.772112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:07.772112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:07.774026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 389/799] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:07.778642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.785516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:07.871071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf39b18-f01e-46aa-84a3-38aa88c11f25 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.901436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f9949f-89b1-42bb-86c7-125d163992d0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:07.908018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.908966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.909447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.909961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.922111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.923766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.937843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:07.938452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:07.938732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:07.939005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:07.939649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:07.939953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:07.941326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:07.943343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:07.944227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:07.945916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:07.945916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:07.945916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:07.947935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 411/800] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:07.948924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.954792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 390/801] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:07.955637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:07.982446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.024835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.062618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1b47f-3e3c-4cfa-b270-5866d45995b7 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.067656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff998d7b-ec15-4659-be86-30042cd67e3f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.103037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.103663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.103940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.104212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.104792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.106239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.106865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.107471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.107907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.108194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.109132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:08.109502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.110846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa745b-c890-4ffb-8846-f3f471b3a0cc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:08.114912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:08.115852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:08.123075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 412/802] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:08.124918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.130026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 391/803] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:08.131366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a479-5ca0-4833-b841-5077c149dd89 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.131649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a479-5ca0-4833-b841-5077c149dd89 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.132048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe0a479-5ca0-4833-b841-5077c149dd89 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.133613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 392/804] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:08.137555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a479-5ca0-4833-b841-5077c149dd89 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.224120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.235794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b0529-4851-4b0a-831e-1a5dd93f1643 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.240766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe0a479-5ca0-4833-b841-5077c149dd89 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.266771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.272694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.273831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.274131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.274401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.278479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.279078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.279356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.279623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.280251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:08.280555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.281348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.281999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.282784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.286810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 393/805] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:08.292389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-fa5a0cf7-fd28-48a0-bd93-9d72cb7b9dda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:08.294914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:08.295957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:08.296856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 413/806] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:08.297335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.297335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.297896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.323073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:08.324452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:08.399847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 414/807] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:08.401015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.415181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d69eea-4cc4-41cc-b88a-1b0302714870 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.466577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.467521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.467808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.468088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.478003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.483773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.492065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:08.501886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:08.502925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:08.503800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:08.506052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 394/808] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:08.507766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.523225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6169b-1ea4-422c-bf61-483a7dad99bb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.566773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.568460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.570331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.570912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.571390 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.572267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:08.572774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.574379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.584567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 415/809] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:08.585882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.635111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174702bb-537f-4d8a-888e-09f1ff79a18e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.682925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.683547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.683830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.684102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.685085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:08.685407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.687154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.697486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e3bc2-7445-444c-b4ae-03bd847f61ff None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.703047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 395/810] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:08.704041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.739159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.740012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.740354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.741594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.742375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:08.742634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.744056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.763767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 416/811] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:08.764651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.775298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.815218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cc896-1d04-419a-81c3-9840e1cf6f9d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.826133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:08.854287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.854893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.855172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.855443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.856107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:08.857461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:08.871418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94b0a4-27df-4802-9e06-7e9b2b0bd508 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:08.883595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 396/812] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:08.884636 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:08.928807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:08.930059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:08.930340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:08.930614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:08.946995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:08.952893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:08.953953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:08.954798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 417/813] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:08.956281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:09.018744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f66b-db3f-4a29-bc1f-046e187b9dd2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:09.029292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.064278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99db98c1-142d-4a64-8fe1-97b32f2593ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:09.064944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db98c1-142d-4a64-8fe1-97b32f2593ce None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.065225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db98c1-142d-4a64-8fe1-97b32f2593ce None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.065501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99db98c1-142d-4a64-8fe1-97b32f2593ce None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/5be0312450644dd69a7c7263e347b28b/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.067927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db98c1-142d-4a64-8fe1-97b32f2593ce None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=5be0312450644dd69a7c7263e347b28b, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:09.069482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99db98c1-142d-4a64-8fe1-97b32f2593ce None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:09.086916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 397/814] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:08 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/5be0312450644dd69a7c7263e347b28b/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:09.089034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45dcac-aaf0-4335-bc31-d3b25c900ef9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.089337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45dcac-aaf0-4335-bc31-d3b25c900ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.089624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c45dcac-aaf0-4335-bc31-d3b25c900ef9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.095287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 398/815] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:09.096257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45dcac-aaf0-4335-bc31-d3b25c900ef9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:09.103461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98765f64-f2cf-47fd-9aad-982117593c29 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:09.152152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b48c7-086f-49f7-9b79-1fec3723f28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:09.152911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b48c7-086f-49f7-9b79-1fec3723f28b None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.153186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b48c7-086f-49f7-9b79-1fec3723f28b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.153532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b48c7-086f-49f7-9b79-1fec3723f28b None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/6896402969554f88ae946f35aed55bc5/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.172959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b48c7-086f-49f7-9b79-1fec3723f28b None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=6896402969554f88ae946f35aed55bc5, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:09.174692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b48c7-086f-49f7-9b79-1fec3723f28b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:09.197740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 418/816] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:08 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/6896402969554f88ae946f35aed55bc5/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:09.197740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.197740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.197740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.218166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:09.219663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:09.308810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 419/817] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:09.318673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.450090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c45dcac-aaf0-4335-bc31-d3b25c900ef9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:09.495987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:09.496602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.496883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.497207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.497938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:09.498244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:09.499625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:09.510086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 399/818] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:09.518830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:09.567204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.610332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:09.646827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c0141-575a-4494-92cd-e5f440689874 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:09.705806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:09.706453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.706695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.706966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.726474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:09.727929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:09.740333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:09.753217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:09.754235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:09.755378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:09.755378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:09.755378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:09.758423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 420/819] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:09.764111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4b9f6-f3ea-46c8-9dd4-b48137d5c3bf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:09.766360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:09.814448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:09.815090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.815375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.815900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] PATH_INFO: `/v3/services/network` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.816592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:09.820562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:09.847044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:09.848073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:09.848880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 400/820] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:09 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:09.858742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:09.895144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:09.902430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8fa395-7e7c-435a-b444-4cd9c32e2677 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:09.939911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:09.940620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:09.941020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:09.941371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:09.942248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:09.942635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:09.944094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:09.964071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 421/821] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:09.969480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.078084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b26298-5291-4f09-9f38-b555043f8b16 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.119304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.119915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.120198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.120474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.121113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] RBAC: Adding query filter params (name=network) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:10.121418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.122887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.128612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 401/822] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:10.136734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.154065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:10.158677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb20e14-1a1f-410e-9909-a1ffc59ed4a5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.245638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97141d-a548-4900-8854-bf8652032489 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.283755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.284522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.284989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.285364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.285988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.286259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] RBAC: Adding query filter params (type=network) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:10.286662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.287089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.287534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.287949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.288507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.294214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 402/823] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:10.305519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.306038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.307696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:10.335783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:10.336739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:10.337653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:10.338213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 422/824] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:03:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:10.344599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.373148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:10.408784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:10.462056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e16e88-0b3f-41eb-896d-eb0135b0665a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.533018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.533633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.533949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.534222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.534905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.539480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b399f-9d9e-49d5-9e95-e612d71078ab None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.541196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.578430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.579193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.579562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.580161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.580988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:10.581365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.583141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:10.603654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 403/825] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:10 2022] POST /identity/v3/endpoints => generated 337 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:03:10.605376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 423/826] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:03:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:10.611096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:10.776851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bb9a00-4bb1-48e9-bf23-07b347b2c742 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:10.811720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:10.818959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70a999-8067-42b6-8c5f-8c4c335981ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:10.820146 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a999-8067-42b6-8c5f-8c4c335981ac None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:10.820432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a999-8067-42b6-8c5f-8c4c335981ac None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:10.820707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70a999-8067-42b6-8c5f-8c4c335981ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:10.898624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a999-8067-42b6-8c5f-8c4c335981ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:10.900098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70a999-8067-42b6-8c5f-8c4c335981ac None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.004174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 404/827] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:11.010316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.085807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.120661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce624bdf-3413-40b6-8e0f-87425113ba7a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.157253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41481077-96be-4931-83f3-7e7f933a8e23 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.157535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41481077-96be-4931-83f3-7e7f933a8e23 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.157740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41481077-96be-4931-83f3-7e7f933a8e23 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.159950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 405/828] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:11.167149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0bb1-4dae-4001-8735-9a660da9f017 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.167660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0bb1-4dae-4001-8735-9a660da9f017 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.168046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003c0bb1-4dae-4001-8735-9a660da9f017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.172102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.172930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.173353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.173821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.185988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.187645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.187946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-003c0bb1-4dae-4001-8735-9a660da9f017 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:11.189243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-003c0bb1-4dae-4001-8735-9a660da9f017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:11.204525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:11.205656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:11.206788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:11.206788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:11.206788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:11.208621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 424/829] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:11.214385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.217438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.271078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 406/830] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:11.329741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f88e6b-c989-46fb-a47a-87b6d708bd18 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.355040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.356773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9f16-2ea6-4ea8-9555-378ede4ddcc3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.357101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9f16-2ea6-4ea8-9555-378ede4ddcc3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.357416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df9f16-2ea6-4ea8-9555-378ede4ddcc3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.359227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 407/831] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:11.365883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.366966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.367462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.368643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.369259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.369544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.369854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.370507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:11.370813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.372299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.389256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:11.390862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:11.474257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 408/832] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:11.509851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 425/833] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:11.511590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.579694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.613232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.625901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c77ef-2946-430d-8428-2c7f4fbf7b24 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.668156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.668779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.669078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.669333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.676138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.677649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b3dc5c3e-71cf-44c3-86ee-fe2ffb275526 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:11.689307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:11.690379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:11.691256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 409/834] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:11.691936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7fab-464d-4547-b0f2-850b548e7eb1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.692220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7fab-464d-4547-b0f2-850b548e7eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.692491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd7fab-464d-4547-b0f2-850b548e7eb1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.697538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 410/835] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:11.697538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7fab-464d-4547-b0f2-850b548e7eb1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.698199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6b6f1-bdc9-4734-9f99-f84253b803d9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.739655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.741048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.741607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.742077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.742673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.744034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-2987e940-9ebe-4f0f-b088-4768886a1466 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:11.752911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:11.754026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:11.755143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 426/836] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:11.755919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.755919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.755919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.774579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:11.775764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:11.807051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd7fab-464d-4547-b0f2-850b548e7eb1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.819738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.842336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.842932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.843210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.843479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.849920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 427/837] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:11.850054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:11.850054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:11.850219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.850296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:11.868294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 411/838] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:11.869866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:11.885903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:11.955718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10ef1d-0e5f-4aa1-98f1-a6ba02077ef3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:11.992337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:11.993086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:11.993199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:11.993430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:11.996005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd667323-f4e7-4eca-a750-f8c89cb89b3a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.003788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:12.009447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:12.010883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:12.011718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 428/839] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:12.012398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.040336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.040948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.041235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.041517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.042186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.042495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.043854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.048411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 412/840] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:12.049176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.059590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.125998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc72d7-2c30-415d-9b86-19dc93a3b00c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.128960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.155159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11902863-b3b1-4632-9dd3-d0b0474d8cad None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.161999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.162630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.162912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.163315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.164183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=118462014bfa41e388b6bb0be1d208d0) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.164498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.165950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.171629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 429/841] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/role_assignments?user.id=118462014bfa41e388b6bb0be1d208d0&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:12.172404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.192107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.192727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.193179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.193286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.193967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.194932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.197264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.211683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 413/842] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:12.212676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.292618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aeb0dc-1acf-41cf-83de-391e79f63bec None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.294867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.323445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86676a1-12cb-479b-8fa2-9b6c91ac9dc7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.337116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.337472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.338660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.338660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.338660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.339024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.340418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.345772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 430/843] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:12.346203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.367010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.367666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.367945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.368221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.374944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.383628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:12.388994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:12.390033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:12.390966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 414/844] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:12.397902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.503149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04022fb9-5d7c-4df2-9c70-b9096a0c99a9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.533068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ed886-511b-4a59-8d9c-0ae8ac1dbf62 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.549047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.549602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.549908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.550178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.564001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.566086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.574081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.575088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.575570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.576050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.576969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.577474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.579109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:12.583023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:12.583944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:12.585794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:12.585794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:12.585794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:12.585794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 431/845] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:12.590627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.596077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 415/846] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:12.602983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.618320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.683194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.727767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7faec-b6dd-4d0e-93ef-3ac43c46a51d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.735739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2546f31d-a399-449b-b22f-cbb5e43ed2b6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.773414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.774271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.774569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.774848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.776250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.777356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.778162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.778641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.779500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.780001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.781563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.785656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.787084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:12.798667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 432/847] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:12.809828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:12.810768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:12.811644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:12.811644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:12.811644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:12.811811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.811881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 416/848] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:12.811881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:12.908801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.937918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db19c1-a413-4b3c-b61a-4a432f48e041 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.941542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d835c7d-72d9-4454-a38a-b75840918605 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:12.953055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:12.987048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.987892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.988281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.988660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.988841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:12.989519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:12.989832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:12.990072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:12.990397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:12.990823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:12.992195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.000115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.002271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.010099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 417/849] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:13.011499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:13.018659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:13.019894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 30 00:03:13.020919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:13.029153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 433/850] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:13.029864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.138207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b4e868-f803-4530-9b9c-ab554d11347b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.153132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d139484-46ff-44fd-8020-78fc7a2f98b6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.176181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.176891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.177251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.177673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.178460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:13.178918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.180488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.190384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.200062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.201052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.201514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.201987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.206846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 434/851] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:13.207854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.216666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.218328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:13.232464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:13.233406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:13.234344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:13.238372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 418/852] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:13.239852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.276251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.340119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e110e57-a4b2-42ad-8d61-fd9aa49e21c8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.363310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ed904-7352-46cb-9f91-9e091761d6dd None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.384693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.385338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.385623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.385927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.411222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.411758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.412044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.412325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.414256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:13.414575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.416356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.446262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 419/853] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:13.447687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.457405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.464699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.466461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.570661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.580965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 435/854] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:13.589752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.589955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bad783-c1ea-4eaa-b4d0-2c55ca791b4f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.638389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.639393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.639681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.639958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.687886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.694777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e36a0c-00aa-4e9e-a06d-6dae48f77220 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.732797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.733471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.733898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.734168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.736184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.737991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.745190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.746634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:13.763281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:13.764282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:13.765161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:13.765161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:13.765161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:13.769483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 436/855] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:13.770369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.840843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.861854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 420/856] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:03:13.866639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.892755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fec99d-af9f-424e-a847-2b2ec8ac2436 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:13.942051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:13.943485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:13.943925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:13.944393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:13.945570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:13.946373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:13.948187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:13.968773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 437/857] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:13.970857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:13.984663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:13.993887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a4acd-4271-4f9a-ba09-7aa046204cd4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.032315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.033336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.033844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.034313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.045567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.047731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:14.064000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:14.064989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:14.065940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:14.065940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:14.065940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:14.068111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 421/858] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:14.074966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.097317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab3a059-82b1-4c19-b792-6c807ffc63a6 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.128092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.141193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.142242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.142820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.143292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.151774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.153780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:14.166621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:14.167642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:14.168516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:14.170974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 438/859] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:14.177059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.200335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b5661-d2d9-409c-91dd-87795a2653c8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.236059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.236661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.236939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.237208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.237882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:14.238187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.239544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47cac6-be71-496e-83bf-feb023f3b335 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.259115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 422/860] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:14.259115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9b2d-cafb-48b7-b47c-c7e4a1942810 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.259115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9b2d-cafb-48b7-b47c-c7e4a1942810 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.259115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a9b2d-cafb-48b7-b47c-c7e4a1942810 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.259115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 423/861] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:14.260851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9b2d-cafb-48b7-b47c-c7e4a1942810 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.261572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.300492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c18c2b0-9ac8-44fd-b117-9d7f0575658c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.342877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.344011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.344436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.345082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.346303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:14.347014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.349103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fe471-933b-4dd1-b806-beb16cdc3bfa None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.362308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.364824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 439/862] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:14.365912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.366777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.367232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.372312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a9b2d-cafb-48b7-b47c-c7e4a1942810 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.385407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:14.386658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:14.406964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.407582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.407856 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.408124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.415398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.416822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-48b8637e-0540-4ff6-8bdc-22164af30d77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:14.428348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:14.429565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:14.430487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 424/863] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:14.430967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de04d-b593-4dfa-aa11-6ffc4671d659 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.430967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de04d-b593-4dfa-aa11-6ffc4671d659 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.431282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9de04d-b593-4dfa-aa11-6ffc4671d659 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.432398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 425/864] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:14.433115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de04d-b593-4dfa-aa11-6ffc4671d659 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.457605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 440/865] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:14.458416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.517019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.544039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9de04d-b593-4dfa-aa11-6ffc4671d659 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.560921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d585d-3929-4513-a15d-a731b721c5cf None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.579659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.580254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.580535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.580804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.582031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=5be0312450644dd69a7c7263e347b28b) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:14.582514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.584152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ef8c6-b107-4080-813c-6585c44764c3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.591308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 426/866] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/role_assignments?user.id=5be0312450644dd69a7c7263e347b28b&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:14.592404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.592687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.592957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.607170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.608616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.609150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.609684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.610707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:14.611278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.612524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:14.613364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.613776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:14.633889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 441/867] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:14.638128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.640155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.705742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 427/868] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:14.732826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.793694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d29b4e-22d2-4fa2-a54d-851d56a4dff8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.824968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:14.842539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.842539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.842823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.843155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.844217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=6896402969554f88ae946f35aed55bc5) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:14.844217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.846155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.852473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 442/869] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/role_assignments?user.id=6896402969554f88ae946f35aed55bc5&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:14.859846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa05c0a-fcdf-480d-b279-95d4de28463f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:14.900408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:14.901068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:14.901353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:14.901634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:14.902286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:14.903726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:14.925317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:14.926303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:14.927195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 428/870] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:14.933243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:14.986261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.008513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:15.056572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7905c-d75b-48d9-b00b-d2b0605c5a12 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.107675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.108323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.108565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.108844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.109844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:15.110160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.111538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.112091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e363b-ad2a-444e-bb01-cde63b072617 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.118606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 443/871] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:15.126119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:15.164975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc628029-4e55-4004-9fd0-fa376b001072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.166026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628029-4e55-4004-9fd0-fa376b001072 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.166764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628029-4e55-4004-9fd0-fa376b001072 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.168194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc628029-4e55-4004-9fd0-fa376b001072 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.169091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc628029-4e55-4004-9fd0-fa376b001072 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.170715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc628029-4e55-4004-9fd0-fa376b001072 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.180673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:15.192572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 429/872] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:14 2022] POST /identity/v3/services => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:15.248012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35db73-0e49-4478-aed4-d4eafc76e3b3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:15.298291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:15.299296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:15.299810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:15.300286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:15.301149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:15.301657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:15.303531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e39dd-16e2-44c6-90c0-f20c8ff5c3a1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:15.309733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 444/873] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:16.640730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45716c-1830-46e0-982d-b9502fa57574 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:16.641253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45716c-1830-46e0-982d-b9502fa57574 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:16.641253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45716c-1830-46e0-982d-b9502fa57574 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:16.642874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 430/874] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:16.648804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84d72f-5292-42ce-a305-5a9a350845b9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:16.649207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84d72f-5292-42ce-a305-5a9a350845b9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:16.649380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84d72f-5292-42ce-a305-5a9a350845b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:16.668141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-cc84d72f-5292-42ce-a305-5a9a350845b9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:16.669332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-cc84d72f-5292-42ce-a305-5a9a350845b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:16.739666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 445/875] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:16.918842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d53703-6334-4905-92c8-26e99dce4ec2 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:16.919224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d53703-6334-4905-92c8-26e99dce4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:16.919391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d53703-6334-4905-92c8-26e99dce4ec2 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:16.920972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 431/876] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:16.925954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:16.926246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:16.926525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:16.945973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:16.947171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:16.977253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.017078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 446/877] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:16 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:17.022536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d53703-6334-4905-92c8-26e99dce4ec2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.105558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.131434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d53703-6334-4905-92c8-26e99dce4ec2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.167632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.168514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.168947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.169379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.170175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:17.171695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-2058d1da-4511-4aea-b1ba-5bda46ba5221 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:17.181586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:17.182813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:17.183866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:17.186615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 432/878] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:17.192438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.268021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aacb6-dfc6-460f-8335-1b994292d7ea None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.268304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aacb6-dfc6-460f-8335-1b994292d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.268581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5aacb6-dfc6-460f-8335-1b994292d7ea None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.270361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 433/879] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:17.275465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.275751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.276025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.296133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:17.297318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:17.306322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772483e-c1dc-4fbf-808c-4a4c04d6390c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.341256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.341895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.342180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.342467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.343101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:17.343405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:17.344756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e324989a-3a13-4c49-b978-67d96e161dff None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:17.349202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 447/880] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:17.350915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0d98-7dd8-4cb6-b6a9-b0844bbc19d8 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.351287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0d98-7dd8-4cb6-b6a9-b0844bbc19d8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.351563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619d0d98-7dd8-4cb6-b6a9-b0844bbc19d8 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.354775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 448/881] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:17.354775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0d98-7dd8-4cb6-b6a9-b0844bbc19d8 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.371321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 434/882] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:17.372158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.384622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.448824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.465651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619d0d98-7dd8-4cb6-b6a9-b0844bbc19d8 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.482528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674febc-be0d-4e90-acd7-dc30ddda13d6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.502572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df777-0fbe-40a6-8a82-32bc0c08b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.503294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df777-0fbe-40a6-8a82-32bc0c08b553 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.503656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df777-0fbe-40a6-8a82-32bc0c08b553 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.503937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df777-0fbe-40a6-8a82-32bc0c08b553 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.514550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3df777-0fbe-40a6-8a82-32bc0c08b553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:17.518063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.518670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.518954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.519227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-8e3df777-0fbe-40a6-8a82-32bc0c08b553 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:17.519384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:17.520276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:17.526872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:17.527652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:17.527652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:17.527801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 449/883] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:17.527879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:17.527957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.527957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.527957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.532267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 435/884] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:17.542888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.544860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:17.546138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:17.628317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 450/885] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:17.645772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.672324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.691849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b8d51-535e-4995-bb3c-26244b124678 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.740085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.740611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.740897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.741212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.741925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:17.742234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:17.743709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:17.746425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.754289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 436/886] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:17.760863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.784443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b5ba8-c9f3-4969-ba04-9ddb79400923 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.828304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.828928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.829207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.829478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.830091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:17.831506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:17.841027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:17.842052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:17.842909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 451/887] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:17.848010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.885399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56996816-8234-4de7-9bf0-1f7b3c2b2b36 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:17.928334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:17.929109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:17.929395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:17.929672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:17.941055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:17.942548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:17.947446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:17.958049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:17.958984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:17.960476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:17.960476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:17.960476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:17.960476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 437/888] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:17.960697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:17.973750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e2126-5699-436e-ad94-3dad28bb7103 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.008492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.009060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.009344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.009623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.010296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:18.010600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.011996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.016732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 452/889] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:18.017528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.022152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:18.084648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78840d0-2e9d-4728-b343-854494bb0d3c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.121352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.122282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.122781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.123245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.124079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.125641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.127838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3bd47e-98dd-4e9b-a3da-f118399a0dc5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.141822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 438/890] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:17 2022] POST /identity/v3/services => generated 269 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:18.142659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.195638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.197178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.197691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.198175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.199072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:18.199649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.201308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.221442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 453/891] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:18.222468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.227419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:18.294599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7f2a91-b7bf-44d8-935a-ae63fed222f2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.312034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:18.343308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.343925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c595b85-e7f5-4199-8d7b-e5ab53b2d418 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.344322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.344830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.345250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.346125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:18.346593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.348117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.354126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 439/892] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:18.360306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.387527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.388992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.389751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.390204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.401609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.404166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:18.418591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:18.419666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:18.420579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 454/893] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:18.427352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.497129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf9f8b-52ff-4a60-88e5-e1e41147c995 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.498504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:18.534708 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.535352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.535637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.535916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.536917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] RBAC: Adding query filter params (interface=public, service_id=92d4dcc2c4f54aceb37aa652ce84fd30, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:18.537029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.538931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.546771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 440/894] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/endpoints?service_id=92d4dcc2c4f54aceb37aa652ce84fd30&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:18.555061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.556769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781b8b-3b4d-451c-8bb6-965056780568 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.598350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:18.608555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.609818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.610287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.611030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.612349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:18.612841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.615176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.639608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 455/895] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:18.645234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:18.672292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9739070e-53e0-47fc-bcc0-57c4867af34b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.712669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.713337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.713577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.713887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.714563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.715951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.722276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 441/896] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/services => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:18.772083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beae3e1-c197-4b12-8b28-f2b54d82a7ae None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:18.799013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:18.811531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:18.812150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:18.812430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:18.812701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:18.887340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:18.888775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:18.991820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 456/897] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:18.997190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.105135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c61dc2-02df-4e5c-bbba-bd9f82c6faff None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.106597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:19.141040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.141674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.141987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.142267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.153526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.155069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:19.170150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:19.171138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:19.172597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:19.172597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:19.172597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:19.172597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 442/898] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:19.178900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.203824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:19.297643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17d161-858c-4684-bcc0-bab0e7232d18 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.335864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.336578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.336864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.337143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.337842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:19.338155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.339606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.353062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 457/899] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:19.358637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.466510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e4ae84-a5a6-40bf-86ca-63f0927f23d3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.500007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.500628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.500909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.501182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.508834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.510307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d7a2f90e-f715-41af-b619-5db227601d3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:19.521646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:19.523211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:19.524207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 443/900] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:19.534908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.593793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce241-153e-4a64-9bbc-6bbfb34af720 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.594104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce241-153e-4a64-9bbc-6bbfb34af720 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.594346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1ce241-153e-4a64-9bbc-6bbfb34af720 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.595916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 444/901] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:19.600809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.601278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.601559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.623848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:19.625458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:19.631435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:19.640101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:19.648152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9ddd-2603-4481-9435-b0564659f4d5 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.685145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.685635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.686056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.686476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.687309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:19.687710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.689255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.703941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 458/902] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:19.708460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 445/903] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:19.717741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:19.820915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49752cf2-a809-416f-8015-e081ad9bb8c9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:19.857422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:19.858052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:19.858332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:19.858603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:19.859325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] RBAC: Adding query filter params (role.id=4e11960ddd0842baa576b812a0aa532b, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=6896402969554f88ae946f35aed55bc5) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:19.859631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:19.861056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1e575-909a-4b8d-867e-b3dfd034f0d6 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:19.868271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 459/904] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:19 2022] GET /identity/v3/role_assignments?user.id=6896402969554f88ae946f35aed55bc5&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=4e11960ddd0842baa576b812a0aa532b => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:20.001985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:20.108492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c25e89-2f6d-4c0b-83cb-cfd14c34c7eb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:20.144542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334cac4-bf04-4c8e-8ac4-ecbb42cebbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:20.145507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334cac4-bf04-4c8e-8ac4-ecbb42cebbd3 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.146016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334cac4-bf04-4c8e-8ac4-ecbb42cebbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.146518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334cac4-bf04-4c8e-8ac4-ecbb42cebbd3 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.147402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334cac4-bf04-4c8e-8ac4-ecbb42cebbd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:20.148974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334cac4-bf04-4c8e-8ac4-ecbb42cebbd3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:20.168715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 446/905] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:20 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:20.223151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e064-4cc1-42ef-b4a3-fa4932c1ed64 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.223465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e064-4cc1-42ef-b4a3-fa4932c1ed64 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.223654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57e064-4cc1-42ef-b4a3-fa4932c1ed64 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.225807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 460/906] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:20.232063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.232637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.233119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.241968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:20.255714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:20.258064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:20.340236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 447/907] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:20.607170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e064-4cc1-42ef-b4a3-fa4932c1ed64 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:20.616474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:20.718189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57e064-4cc1-42ef-b4a3-fa4932c1ed64 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:20.754590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:20.755835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.756316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.757491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.758368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:20.759926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-4b9a6295-35cb-456f-b08a-163f7e16913b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:20.769524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:20.770515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:20.771379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:20.774374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 461/908] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Aug 30 00:03:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:20.780993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:20.789850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a01a2-469b-49c1-b87a-4a3efb425aea None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.790457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a01a2-469b-49c1-b87a-4a3efb425aea None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.790952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a01a2-469b-49c1-b87a-4a3efb425aea None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.794552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 462/909] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:20.798960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.799247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.799520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.819779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:20.820994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:20.893651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:20.900682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 463/910] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:20.927766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6bebd-e65a-4608-9b4f-74220c7c62cc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:20.958073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:20.964554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:20.965405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:20.965888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:20.966424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:20.967261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:20.967789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:20.969366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:20.974920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 448/911] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:20.983087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.090895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29ec86e-bccf-4946-9a06-8622c7639772 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.131017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.132020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.132502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.132971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.133825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:21.134345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.135944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.141324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 464/912] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:20 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:21.146955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.219591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.265787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556e113-3599-42e2-a603-4c08feb8da80 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.291782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:21.312490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.313114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.313401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.313680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.314419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] RBAC: Adding query filter params (interface=public, service_id=995e8c80a2aa4cccafd3d6751bde16c2, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:21.314724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.316754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.327834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 449/913] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:21 2022] GET /identity/v3/endpoints?service_id=995e8c80a2aa4cccafd3d6751bde16c2&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:21.330316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.342551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99b3f-f2a3-4dc8-8a26-42cb47198e66 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.386484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.387124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.387404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.387678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.388563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.390100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.397904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:21.402063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:21.403046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 30 00:03:21.403885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:21.408232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 465/914] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:21.409076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.451804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba3c14-6c36-47de-8681-db945f41d241 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.490061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.491149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.491637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.492167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.492995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.494673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.506196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 450/915] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:21 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:21.530862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b928-245d-4fb1-b5a6-5d942743c5bf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.562779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:21.571607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.572237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.572807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.573077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.573748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:21.574061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.575460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.585738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 466/916] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:21.586855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.699605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92962f-f8a8-42dd-86f8-fa2950ffa986 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.723518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:21.736802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.737416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.737696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.738001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.738644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:21.738946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.740312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9afcd4-ca7e-44ef-a274-0cbe4138a68e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.746541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 451/917] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Aug 30 00:03:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:21.752135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:21.857487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b5eb8-64cd-413e-bb25-7e4ae4b4d99a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:21.893976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950413e4-99b4-4df9-aefb-b0fab39ec6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:21.894590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950413e4-99b4-4df9-aefb-b0fab39ec6ea None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.894874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950413e4-99b4-4df9-aefb-b0fab39ec6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.895154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950413e4-99b4-4df9-aefb-b0fab39ec6ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.895887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950413e4-99b4-4df9-aefb-b0fab39ec6ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:21.897292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950413e4-99b4-4df9-aefb-b0fab39ec6ea None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:21.939147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ded9a2-2238-497b-abf3-3f0af4b28f8a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.939431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ded9a2-2238-497b-abf3-3f0af4b28f8a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.939706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ded9a2-2238-497b-abf3-3f0af4b28f8a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.941039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 452/918] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:21.947743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e57c7-f77e-4f24-bad5-a019d21c022d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:21.948024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e57c7-f77e-4f24-bad5-a019d21c022d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:21.948295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e57c7-f77e-4f24-bad5-a019d21c022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:21.951935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 467/919] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:03:21.978168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b53e57c7-f77e-4f24-bad5-a019d21c022d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:21.979476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b53e57c7-f77e-4f24-bad5-a019d21c022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:22.066425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 453/920] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:22.146124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df1ea-4291-43a0-a618-bae0b60e27f1 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.146423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df1ea-4291-43a0-a618-bae0b60e27f1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.146678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836df1ea-4291-43a0-a618-bae0b60e27f1 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.148058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 468/921] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:22.153249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.153748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.153836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.172591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:22.174149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:22.247312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 454/922] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:22.347273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df1ea-4291-43a0-a618-bae0b60e27f1 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.399034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:22.454161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836df1ea-4291-43a0-a618-bae0b60e27f1 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:22.489280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:22.490010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.490293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.490568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.502182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:22.507238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:22.508231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:22.509207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:22.513292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 469/923] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:22.514781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.514928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.570094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:22.623238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464540-b839-454a-a0d4-eec2c7e7e67b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:22.633481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:22.642625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e36eab-ce3d-4686-a070-77df127d59b8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:22.668573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:22.669629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.670144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.670679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.671469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:22.673028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:22.682481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:22.683510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:22.684360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:22.691400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:22.691400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.691400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.691400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.691768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:22.691768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:22.691768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:22.692448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 470/924] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:22.694918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.705789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 455/925] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:22.707252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.809572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62ea61-cd2b-4ef2-b35c-e1f9d19671e1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:22.828125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0150f-dfcd-4d5c-aaaf-cdc9e9fdc268 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:22.830597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:22.849178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:22.850166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.851512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.851997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.852865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:22.853410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:22.854986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:22.864638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 471/926] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:22.866230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.868719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:22.869408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:22.869642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:22.869944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:22.881296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:22.882856 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:22.898411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:22.899410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:22.900303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:22.900303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:22.900303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:22.904269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 456/927] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:22.905451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:22.908209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:22.980027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f3753-e757-4c67-8e37-5e54ec25dacb None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.017249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.017454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2172c-ce3d-4fc7-8bac-f5cf545827c1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.018381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.018872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.019358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.020181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:23.020683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.022849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.033404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 472/928] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:23.034642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.053554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.053970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.054258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.054588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.055318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:23.055619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.057122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.075270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 457/929] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:23.076523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.118060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.151645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.155346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23a31d-5385-44df-9754-48b3879a8c10 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.193060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.193851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.194784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.195151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.195932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] RBAC: Adding query filter params (interface=public, service_id=1617249c629e4606aa2506cfbd714ea1, region_id=RegionOne) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:23.196216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105de332-f2f0-477b-8e36-3822bfa69d1d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.196655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.197738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.207806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 473/930] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/endpoints?service_id=1617249c629e4606aa2506cfbd714ea1&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:23.208892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.242098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.242904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.243192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.243470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.253847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.257064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:23.271797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:23.273513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:23.274830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:23.277772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 458/931] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:23.279964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.343719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090620ab-e81f-41e2-a21c-a72f27e4be1c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.387857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.389212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.389737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.390492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.391547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.393724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.398157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.405768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575576a-8c72-4e5d-b015-2e6795cad799 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.406382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 474/932] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/services => generated 1497 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:23.450421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.451071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.451356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.451628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.452455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:23.452775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.454290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c6b51-e008-49bd-970e-7cb71bdbfbc3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.479623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 459/933] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:23.481058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.532095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.588486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303934-9976-49c3-8b5a-3fdfa929b1aa None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.588796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303934-9976-49c3-8b5a-3fdfa929b1aa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.589051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff303934-9976-49c3-8b5a-3fdfa929b1aa None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.590728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 460/934] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:23.595660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.595969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.596319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.598123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74a8fc-3ebb-418d-aec0-825144c811ba None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.624636 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:23.626288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:23.638559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.639197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.639481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.639755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.651331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.652777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:23.668674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:23.669654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:23.670577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:23.670577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:23.670577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:23.670577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 475/935] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:23.679365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.710943 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 461/936] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:23.776279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.798016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf95cb-de2b-4e71-808b-4e20ce3bceb7 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.834034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:23.835101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:23.835594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:23.836077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:23.836922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:23.837460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:23.839078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:23.852335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 476/937] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:23.861743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:23.924910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:23.970451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8798a7-9d7a-47ce-81bd-78fba54b8073 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:23.986500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.013603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.014940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.015529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.015953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.025657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.027153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-4891b37c-aeb9-470e-8e6b-06b55ea34678 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:24.040083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:24.041194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:24.042359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 462/938] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:24.042982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba268a84-04e2-4d6d-804c-7e9708066867 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.042982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba268a84-04e2-4d6d-804c-7e9708066867 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.043194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba268a84-04e2-4d6d-804c-7e9708066867 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.044539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 463/939] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:24.046828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba268a84-04e2-4d6d-804c-7e9708066867 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.103336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52420b4-0408-4820-bcbd-1b03cfeb998d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.139856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.140638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.141004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.141388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.142078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.143489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b0b2b4f8-8a9f-4e0f-93b2-6ce4e1855afb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:24.154870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:24.155828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 30 00:03:24.156716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.157449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba268a84-04e2-4d6d-804c-7e9708066867 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.158285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 477/940] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Aug 30 00:03:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:24.159563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.159930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.160305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.168623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:24.179921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:24.181137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:24.184605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:24.196711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.197517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.197644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.197932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.198603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:24.198895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.200321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.213180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 464/941] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:24.213837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.254095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 478/942] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:24.262576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.345332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c587169c-5e7c-4f9c-88a5-86cddbb092bf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.372961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b90d9-48d1-4cfa-9c49-322fa6f1aa53 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.393506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.395014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.395552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.396276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.397382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:24.398324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.400427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.407932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 465/943] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:24.411418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.412578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.413639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.414331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.414683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/6896402969554f88ae946f35aed55bc5/roles/4e11960ddd0842baa576b812a0aa532b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.417222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=6896402969554f88ae946f35aed55bc5, role_id=4e11960ddd0842baa576b812a0aa532b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.418928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.421503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:24.445739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 479/944] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:24 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/6896402969554f88ae946f35aed55bc5/roles/4e11960ddd0842baa576b812a0aa532b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:24.486005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:24.529508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.555380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b066b60-4d53-4cd8-bcc6-064789178d26 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.592868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.593511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.593821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.594109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.595160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:24.595160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.596610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.603593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 466/945] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:24.615560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.652658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff88b47-6412-4d52-b72f-a4597339337c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.697948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.698861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.699782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.700262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.701108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.703402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.707396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING keystone.server.flask.common [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:03:24.725128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836607a-c25e-45bb-9f9f-e8422377ae71 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.730758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.sql.core [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:03:24.730758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:03:24.730758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [parameters: {'id': 'a9d745e1ade64aa19a4d1e1012a4cf6c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:03:24.730758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81662) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9d745e1ade64aa19a4d1e1012a4cf6c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9d745e1ade64aa19a4d1e1012a4cf6c. Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:03:24.755776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application result.read() Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 30 00:03:24.756710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application yield resource Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise self.value Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application session.commit() Aug 30 00:03:24.757875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:03:24.758909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:03:24.760717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application result.read() Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:03:24.763070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [parameters: {'id': 'a9d745e1ade64aa19a4d1e1012a4cf6c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.765571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:24.766705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9d745e1ade64aa19a4d1e1012a4cf6c. Aug 30 00:03:24.767791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.768825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:24.768913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 480/946] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Aug 30 00:03:24 2022] POST /identity/v3/projects => generated 262 bytes in 235 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:24.770735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:24.773666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.775412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.775852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.776279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.777095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.778779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.808070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 467/947] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:24.843971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:24.907060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa741b-d442-489d-86d1-41766c05edd1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:24.956497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:24.957134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:24.957412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:24.957683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:24.966106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:24.967682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-83a56087-75a4-4971-a651-7d1918febf81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:24.980226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:24.981123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:24.982385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 481/948] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:24.987318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:25.102806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee382f-8ff8-41ed-95c3-3130395102f8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:25.139368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:25.139984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:25.140268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:25.140543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:25.141215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:25.141614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:25.143086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678d834-fbf6-410a-9267-bf0f9b159300 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:25.161595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 468/949] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:25.454929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214540e7-424c-4d97-89d6-ebe50e2faf54 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:25.455429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214540e7-424c-4d97-89d6-ebe50e2faf54 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:25.455429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214540e7-424c-4d97-89d6-ebe50e2faf54 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:25.457037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 482/950] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:25.462438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:25.462843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:25.463028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:25.483243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:25.484439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:25.510185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:25.562047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 469/951] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:25.829665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214540e7-424c-4d97-89d6-ebe50e2faf54 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:25.961839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214540e7-424c-4d97-89d6-ebe50e2faf54 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:25.969115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:26.004739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:26.005923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.006345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.006981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.007741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:26.009330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:26.019227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:26.020459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:26.021468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:26.024091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 483/952] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:26.032191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:26.135993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a62f9-f5fc-4dc2-98fb-4ecd29d7614f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:26.170761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:26.171590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.172053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.172463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.173240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:26.173686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:26.175199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:26.181057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 470/953] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:26.186569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:26.291539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9284d8-21bc-4c80-ad21-1920099b825a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:26.326194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:26.326802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.327087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.327363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.328001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:26.328363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:26.329861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce15e84-f6fd-41bf-b28e-ad131095e236 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:26.335277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 484/954] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:26.340950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:26.368577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:26.449861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fa684-d82d-46c9-983d-e073742a2a26 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:26.486195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531bf4a5-ddc0-481c-981c-a292ab7a3dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:26.487563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf4a5-ddc0-481c-981c-a292ab7a3dd6 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.488029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf4a5-ddc0-481c-981c-a292ab7a3dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.488489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531bf4a5-ddc0-481c-981c-a292ab7a3dd6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.489397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf4a5-ddc0-481c-981c-a292ab7a3dd6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:26.491057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531bf4a5-ddc0-481c-981c-a292ab7a3dd6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:26.512439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 471/955] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:26.526999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380ff5d-56ee-47b3-aa5f-d1e5fe871391 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.527545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380ff5d-56ee-47b3-aa5f-d1e5fe871391 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.527545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380ff5d-56ee-47b3-aa5f-d1e5fe871391 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.529183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 485/956] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:26.535069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069672d-39f2-4872-af4d-16239cc9f7a3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.535676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069672d-39f2-4872-af4d-16239cc9f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.536131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069672d-39f2-4872-af4d-16239cc9f7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.557664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3069672d-39f2-4872-af4d-16239cc9f7a3 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:26.559337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3069672d-39f2-4872-af4d-16239cc9f7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:26.643819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 472/957] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:26.915002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091de796-4075-4884-863b-4555872fc82d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.915716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091de796-4075-4884-863b-4555872fc82d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.916213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091de796-4075-4884-863b-4555872fc82d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.918039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 486/958] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:26.924163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:26.924691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:26.925163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:26.927253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091de796-4075-4884-863b-4555872fc82d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:26.934681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:26.946635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:26.948579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:26.972595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.037259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 473/959] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:27.059788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091de796-4075-4884-863b-4555872fc82d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.095894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa8c114-d828-4864-9a61-dd640ec2f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.096801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8c114-d828-4864-9a61-dd640ec2f210 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.097234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8c114-d828-4864-9a61-dd640ec2f210 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.097668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8c114-d828-4864-9a61-dd640ec2f210 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.110226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa8c114-d828-4864-9a61-dd640ec2f210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-7fa8c114-d828-4864-9a61-dd640ec2f210 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:27.115316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:27.117418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:27.118507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:27.124110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 487/960] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 00:03:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:27.125655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.236379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f7bae9-5561-4940-985d-fe0ff463af9e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.255831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702359-9243-4114-8dda-5a26e0172f70 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.256247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702359-9243-4114-8dda-5a26e0172f70 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.256447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e702359-9243-4114-8dda-5a26e0172f70 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.258078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 488/961] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:27.262893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.263185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.263473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.274095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.274694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.274972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.275245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.275911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:27.276214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.278033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.279702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.282691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:27.284215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:27.289449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 474/962] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:27.298685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.356233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 489/963] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:27.366753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.397588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.414534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e58a7f-9e16-4ae8-ba3f-45847f939270 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.452839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.453966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.454460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.455034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.468072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.469870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.473715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b01d20-c0b2-4e70-ac2d-9b26dd7dab06 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:27.486900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:27.488225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:27.489153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:27.489153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:27.489153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:27.496085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 475/964] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:27.497666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.509912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.510545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.510824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.511094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] PATH_INFO: `/v3/services/compute` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.511679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.513038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:27.521958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:27.523670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:27.524553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:27.529077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 490/965] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:27.529913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.594112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.618234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53e82f-ea8f-45a0-99be-b4f613b5ca12 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.622019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.636718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b0b51-64c0-4b72-a48e-44000ee473ce None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.663149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.663910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.664301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.664702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.665452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:27.665897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.667358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.672474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.673078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.673356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.673626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.674283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:27.674583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.676049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.680570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 476/966] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:27.685518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 491/967] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:27.686315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.686506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.788803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a0baf-a918-459e-b782-d00ec4a741b6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.794795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac084ac-f985-4f01-b16d-1d4d6fe6b331 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:27.799873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.832752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.833206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:27.833576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.833947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.834096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:27.834340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.834556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:27.835602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:27.835803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.836373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:27.836744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:27.837432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.838235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:27.840120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING keystone.server.flask.common [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 30 00:03:27.854241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 492/968] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:27.854241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:27.862049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.sql.core [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:03:27.862049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:03:27.862049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [parameters: {'user_id': 'be6c2085471648d4861a73bd1e021668', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:03:27.862049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81661) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 30 00:03:27.875440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 30 00:03:27.876042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:03:27.877081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application yield resource Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application next(self.gen) Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.rollback() Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.force_reraise() Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise self.value Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application session.commit() Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 30 00:03:27.878323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._prepare_impl() Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.session.flush() Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._flush(objects) Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application compat.raise_( Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application flush_context.execute() Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rec.execute(self) Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 30 00:03:27.879416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 30 00:03:27.884376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result = self._query(query) Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application conn.query(q) Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application result.read() Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 30 00:03:27.885445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [parameters: {'user_id': 'be6c2085471648d4861a73bd1e021668', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:27.886510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 30 00:03:27.887492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:27.889599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 477/969] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Aug 30 00:03:27 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:27.894736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.030856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb2a916-dafc-4f44-9215-3c48429de769 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:28.040853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8dda6-d2cd-4634-b15a-900e0eed6527 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:28.084961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:28.085769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.086124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.086633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.093783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:28.094528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.094881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.095223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.096923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:28.103226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:28.104563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:28.107096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:28.118123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:28.119114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:28.120044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 493/970] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:28.125324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:28.130113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:28.131055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 30 00:03:28.132685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:28.141175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 478/971] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:28.142417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.188791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:28.242371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:28.273610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434872e1-091d-4ce0-b3c7-8092d67d62e9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:28.291602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17674480-afe4-4347-ba8a-99b6c19b639b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:28.318454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:28.319931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.320587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.321025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.322123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:28.322711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:28.324294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:28.343076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:28.343972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.344442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.345609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.346511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:28.347262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:28.348884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09824d26-9b45-4ca8-bc34-6a04fa9307e9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:28.354643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 494/972] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Aug 30 00:03:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:28.356013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.405766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 479/973] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Aug 30 00:03:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:28.495675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91cb7f3-9c35-491d-b422-717334bf570e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:28.502060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62243-1de4-4b8a-bbc0-571393d3267e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.502060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62243-1de4-4b8a-bbc0-571393d3267e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.502060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62243-1de4-4b8a-bbc0-571393d3267e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.502924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 480/974] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:28.509222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.509787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.509787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.533443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:28.535110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:28.541754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:28.541754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.541754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.541754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.544314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:28.633776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:28.635326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:28.641744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 481/975] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:28.782959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 495/976] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:28 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:28.789695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.809605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:28.895964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe3118-6500-4a46-8cb2-ddbffbd2bbc2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:28.938830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.940261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:28.940900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:28.941183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:28.941461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:28.951925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:28.953386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:28.968959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:28.970049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:28.970939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:28.970939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:28.970939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:28.970939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 482/977] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:28.976220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:28.982995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.052614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.057648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a891872e-c81f-4578-b289-6462e861de6c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.092695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47270cc-95eb-41cd-bf8b-e3e56284a233 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.097498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.098408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.098903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.099355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.100208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.101612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:29.111152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:29.112221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:29.113903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 496/978] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:29.118606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.132278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.132888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.133171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.133444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.134124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:29.134431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.135802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.148638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 483/979] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:29.154437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.223546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.227468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a27322-c224-49cc-a0b5-cfc73cabc0fa None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.263601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450b0af-5d86-4aae-97ab-bf13afb42cb7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.265068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.265699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.266010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.266286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.266918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:29.267224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.268571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.274453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 497/980] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:29.279810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.295995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.304108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.304733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.305063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.305330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.312225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.313655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:29.325651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:29.326841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:29.327714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 484/981] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:29.332390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.392848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98552822-43a5-4208-8274-47bcd9009036 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.427534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.428145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.429062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.429593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.429883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:29.430194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.431539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.436315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 498/982] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:29.442124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.443695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611854f-3264-45c3-b80e-ce5beec78077 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.471239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.483883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.484521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.484805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.485074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.485841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:29.486103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.487531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.503145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 485/983] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:29.509126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.555218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4dfe95-0808-4312-942f-40d7d295e9cf None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.560229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.595584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.596191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.596472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.596745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.597542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] RBAC: Adding query filter params (interface=admin, service_id=1617249c629e4606aa2506cfbd714ea1, region_id=RegionOne) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:29.597804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.599153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.605726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 499/984] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/endpoints?service_id=1617249c629e4606aa2506cfbd714ea1&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:29.611103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:29.620332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671c7dd-0c82-4a5f-8fb9-0484ac81ad19 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.659157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.659684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.660244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.660369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.665983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] RBAC: Adding query filter params (role.id=4e11960ddd0842baa576b812a0aa532b, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=6896402969554f88ae946f35aed55bc5) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:29.666305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.667744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e21ed8-bddc-4e88-a25c-ff735fc67322 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.674479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 486/985] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/role_assignments?user.id=6896402969554f88ae946f35aed55bc5&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=4e11960ddd0842baa576b812a0aa532b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:29.715593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:29.727677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf43e38-57e0-4742-aa10-3d283f14cbd0 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:29.768095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969fdc9c-8203-4191-89e5-89b2ac83c401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:29.768716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fdc9c-8203-4191-89e5-89b2ac83c401 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.768997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fdc9c-8203-4191-89e5-89b2ac83c401 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.769268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969fdc9c-8203-4191-89e5-89b2ac83c401 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.769913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fdc9c-8203-4191-89e5-89b2ac83c401 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:29.771292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969fdc9c-8203-4191-89e5-89b2ac83c401 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:29.786000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 500/986] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:29 2022] GET /identity/v3/services => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:29.962513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4867-ac92-47a9-89e2-b5e8a5b60d68 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.962803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4867-ac92-47a9-89e2-b5e8a5b60d68 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.963083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec4867-ac92-47a9-89e2-b5e8a5b60d68 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.964455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 487/987] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:29.969952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e562-f5dd-4cf3-a3a2-c67c130d7d1b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:29.970248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e562-f5dd-4cf3-a3a2-c67c130d7d1b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:29.970524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82e562-f5dd-4cf3-a3a2-c67c130d7d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:29.989047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9a82e562-f5dd-4cf3-a3a2-c67c130d7d1b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:29.990406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9a82e562-f5dd-4cf3-a3a2-c67c130d7d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:30.061384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 501/988] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:30.332559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4867-ac92-47a9-89e2-b5e8a5b60d68 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:30.434890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec4867-ac92-47a9-89e2-b5e8a5b60d68 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:30.449530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:30.470341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f1af5-afa2-4962-9302-be40916e2d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:30.470947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1af5-afa2-4962-9302-be40916e2d99 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:30.471235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1af5-afa2-4962-9302-be40916e2d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:30.471510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1af5-afa2-4962-9302-be40916e2d99 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:30.472170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f1af5-afa2-4962-9302-be40916e2d99 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:30.473526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f1af5-afa2-4962-9302-be40916e2d99 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:30.488459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 488/989] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:30 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:31.643456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a080205-cf07-4adf-8f57-0f8aaa2fa7f8 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:31.643981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a080205-cf07-4adf-8f57-0f8aaa2fa7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:31.644060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a080205-cf07-4adf-8f57-0f8aaa2fa7f8 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:31.645343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 502/990] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:31.651182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:31.651619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:31.651807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:31.670183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:31.671365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:31.730520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e843e-ced2-41e8-b9e9-824327b9cd67 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:31.730801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e843e-ced2-41e8-b9e9-824327b9cd67 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:31.731072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e843e-ced2-41e8-b9e9-824327b9cd67 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:31.732555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 503/991] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:31.737360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:31.737645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:31.737997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:31.751937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 489/992] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:31.756806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:31.758258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:31.827312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 504/993] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:32.028973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.096284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.112965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:32.186256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:32.191337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e9957-9480-4356-ac47-0468f19ab3e8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.218068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c291502-0f08-4880-ac4c-8fe7f05b6d39 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.238055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.238683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.238962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.239234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] PATH_INFO: `/v3/services/image` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.239819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.241386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:32.250435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:32.251724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:32.252540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 490/994] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services/image => generated 86 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:32.261541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.270714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.271354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.271637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.271936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.273335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.274635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:32.283816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:32.284811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:32.285615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 505/995] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:32.290889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.374205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:32.398238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793de8a-c93e-4643-8029-795d51444d7f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.398623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a63d3-3636-4f48-85a4-a224cef5d920 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.435175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.436076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.436195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.436692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.436806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.436953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.437231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.437493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.437904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] RBAC: Adding query filter params (name=image) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:32.438227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.438599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:32.439036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.439594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.440669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.445772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 491/996] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:32.449737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 506/997] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:32.454392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.454537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.485360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:32.562335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7647ee3e-be97-4ad2-b04e-efc50ab17e42 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.563625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe781a-d205-49c1-bd36-bf56756d1200 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.596331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.596930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.597208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.597327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.597480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.597843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.598137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:32.598228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.598439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.598532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.599127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] RBAC: Adding query filter params (type=image) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:32.599429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.599841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ad036-cfc4-4c4a-8938-e1b97c150e44 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.601184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.604967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 507/998] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:32.619167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 492/999] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:32.619389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68881d-5ed7-44de-87af-ae8cbdd2ac38 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.619389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68881d-5ed7-44de-87af-ae8cbdd2ac38 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.619389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f68881d-5ed7-44de-87af-ae8cbdd2ac38 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.619389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 508/1000] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:32.619825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:32.619928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.619928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.619928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.633300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:32.637680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:32.639590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:32.716374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:32.721608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 509/1001] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:32.727753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2d42c-c845-443a-8b3e-a64683df4a8d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:32.766261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:32.766869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:32.767151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:32.767427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:32.768088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:32.769452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:32.786587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 493/1002] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:32.996405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:33.098883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c9149-0475-4f1c-b27e-fd424fb8f656 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:33.136404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:33.142454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:33.143087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:33.143368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:33.143637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:33.144217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:33.145566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:33.155285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:33.156301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:33.157205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:33.158767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 510/1003] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:33.162684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:33.266965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504835d-31d3-4360-a7cf-6ed6f15413d2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:33.301371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:33.301921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:33.302202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:33.302473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:33.303100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] RBAC: Adding query filter params (name=compute) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:33.303958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:33.305317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:33.310296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 494/1004] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:33.315921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:33.419672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ce39c-e24c-4238-8c8f-0817bf6f64b1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:33.454017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:33.454617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:33.454895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:33.455165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:33.455797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:33.456102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:33.457448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:33.467490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 511/1005] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:33.468714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:33.488094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:33.572626 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dd3f2-b2cf-47c3-a957-cdff82cfdcde None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:33.610818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:33.611426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:33.611701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:33.611972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:33.612664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] RBAC: Adding query filter params (interface=public, service_id=0dc3ceca25de4e5ba2346f59a6e63fab, region_id=RegionOne) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:33.612970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:33.614540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705f2da-1145-45ea-ae26-18a8e1da0dd1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:33.625048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 495/1006] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:33 2022] GET /identity/v3/endpoints?service_id=0dc3ceca25de4e5ba2346f59a6e63fab&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:33.626588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:33.689668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:33.735807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85b271-d773-4dff-a750-7be8358528c8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:33.770131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714b3a0-bab1-4cd3-ac36-81575d0fcb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:33.770733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714b3a0-bab1-4cd3-ac36-81575d0fcb61 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:33.771011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714b3a0-bab1-4cd3-ac36-81575d0fcb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:33.771347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714b3a0-bab1-4cd3-ac36-81575d0fcb61 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:33.771988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714b3a0-bab1-4cd3-ac36-81575d0fcb61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:33.773829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714b3a0-bab1-4cd3-ac36-81575d0fcb61 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:33.781752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 512/1007] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:33 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:34.541994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c198c5b-f5a8-43ef-8283-bdfe2cf4c728 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:34.542538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c198c5b-f5a8-43ef-8283-bdfe2cf4c728 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:34.542538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c198c5b-f5a8-43ef-8283-bdfe2cf4c728 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:34.544031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 496/1008] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:34.548857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3776-2c95-4cde-937d-4ade590404dc None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:34.549146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3776-2c95-4cde-937d-4ade590404dc None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:34.549422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d3776-2c95-4cde-937d-4ade590404dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:34.571624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9a0d3776-2c95-4cde-937d-4ade590404dc None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:34.572849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9a0d3776-2c95-4cde-937d-4ade590404dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:34.641788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 513/1009] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:34.736128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d14e3-9011-4b55-83ff-4d624791f72e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:34.736452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d14e3-9011-4b55-83ff-4d624791f72e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:34.736692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d14e3-9011-4b55-83ff-4d624791f72e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:34.738215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 497/1010] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:34.743328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:34.743778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:34.743954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:34.762934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:34.764051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:34.815479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:34.836018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 514/1011] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:34 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:34.913829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d14e3-9011-4b55-83ff-4d624791f72e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:35.010232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:35.031546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d14e3-9011-4b55-83ff-4d624791f72e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:35.065766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:35.066324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:35.066609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:35.066881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:35.067528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:35.068930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:35.084186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 498/1012] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:34 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:35.109661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:35.219895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5b4d0-6d93-41a0-913e-dce70464095b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:35.267852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae4bee-ddb5-435a-84b1-7f67cc19630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:35.268480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4bee-ddb5-435a-84b1-7f67cc19630e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:35.268763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4bee-ddb5-435a-84b1-7f67cc19630e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:35.269034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae4bee-ddb5-435a-84b1-7f67cc19630e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:35.270275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae4bee-ddb5-435a-84b1-7f67cc19630e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:35.271699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae4bee-ddb5-435a-84b1-7f67cc19630e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:35.274304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 515/1013] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:35.280154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:35.385660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e06321-45ef-44f8-b984-13f24bc2a960 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:35.421210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248688f-c8c0-4f17-8691-20e36787fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:35.421843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248688f-c8c0-4f17-8691-20e36787fb78 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:35.422126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248688f-c8c0-4f17-8691-20e36787fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:35.422398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248688f-c8c0-4f17-8691-20e36787fb78 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:35.423056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248688f-c8c0-4f17-8691-20e36787fb78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:35.424551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248688f-c8c0-4f17-8691-20e36787fb78 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:35.436700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:35.454534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 499/1014] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:03:35 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:35.729051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4293-1740-446e-818b-d9d12289af4c None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:35.729399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4293-1740-446e-818b-d9d12289af4c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:35.729523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43e4293-1740-446e-818b-d9d12289af4c None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:35.731063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 516/1015] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:35.736046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:35.736499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:35.736573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:35.754360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:35.755804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:35.825362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 500/1016] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:35 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:36.092916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4293-1740-446e-818b-d9d12289af4c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:36.145846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:36.200696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43e4293-1740-446e-818b-d9d12289af4c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:36.235155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:36.235773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:36.236050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:36.236318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:36.236892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:36.238271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:36.247404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:36.248371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 30 00:03:36.249269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:36.250923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 517/1017] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:36.254678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:36.356683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd9842-2721-4f6b-a134-a4631949cf53 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:36.380882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:36.395448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:36.396052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:36.396387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:36.396662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:36.397826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:36.398135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:36.399503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:36.409060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 501/1018] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:36.410015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:36.514855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d76615e-b131-4cef-80f9-f76dd134e8dc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:36.528098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:36.551433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:36.552380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:36.552815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:36.553866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:36.554658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:36.555116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:36.556769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3e080-db77-47a6-b9c1-73c9aa37dd26 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:36.567028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 518/1019] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Aug 30 00:03:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:36.569313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:36.675048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84a83-351d-4ff2-b9cd-9d72b5ecb62a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:36.710315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d01dcc2-7fb1-4014-98aa-757dab9d448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:36.710922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01dcc2-7fb1-4014-98aa-757dab9d448f None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:36.711203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01dcc2-7fb1-4014-98aa-757dab9d448f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:36.711478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d01dcc2-7fb1-4014-98aa-757dab9d448f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:36.712142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01dcc2-7fb1-4014-98aa-757dab9d448f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:36.713514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d01dcc2-7fb1-4014-98aa-757dab9d448f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:36.741736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 502/1020] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:36 2022] POST /identity/v3/endpoints => generated 334 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:37.035745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ab309-266b-4eeb-9c0a-0b3a2bf02075 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.036099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ab309-266b-4eeb-9c0a-0b3a2bf02075 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.036275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2ab309-266b-4eeb-9c0a-0b3a2bf02075 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.037928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 519/1021] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:37.043061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d523-3ef9-4068-bd55-87f060b16a17 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.043350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d523-3ef9-4068-bd55-87f060b16a17 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.043623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6d523-3ef9-4068-bd55-87f060b16a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.063019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6ff6d523-3ef9-4068-bd55-87f060b16a17 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:37.064251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6ff6d523-3ef9-4068-bd55-87f060b16a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:37.101976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:37.143975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 503/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:37.414881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ab309-266b-4eeb-9c0a-0b3a2bf02075 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:37.418775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0723c7-981f-4703-95fc-674c4f84bcd4 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.420104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0723c7-981f-4703-95fc-674c4f84bcd4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.420395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0723c7-981f-4703-95fc-674c4f84bcd4 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.421795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 504/1023] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:37.427893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.429249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.429533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.451145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:37.452320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:37.522153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 505/1024] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:37.524180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2ab309-266b-4eeb-9c0a-0b3a2bf02075 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:37.558870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:37.559495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.559778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.560051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] PATH_INFO: `/v3/services/image` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.560655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:37.562032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:37.570709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:37.571684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:37.573156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 520/1025] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Aug 30 00:03:37 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:37.577551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:37.672750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:37.678066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdb8be0-dde5-425c-915b-05191dbd9dbd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:37.711724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:37.712323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.712601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.712871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.713498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] RBAC: Adding query filter params (name=image) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:37.713826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:37.715183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:37.724642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 506/1026] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:37.726914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:37.770485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:37.795009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:37.836268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf90fee-c0a8-4537-a8c7-ecfded0a111c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:37.874184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:37.874798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.875084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.875367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.876000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] RBAC: Adding query filter params (type=image) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:37.876307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:37.877667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:37.883135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 521/1027] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:37.889025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:37.900662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca291142-4f8d-440b-bd78-a3da41bea473 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:37.944804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:37.945354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:37.945639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:37.945953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:37.947050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:37.948474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:37.950084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 507/1028] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:37.955564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:37.988305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:38.008290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d336d-9773-4e92-94cb-8a42e1a8d30c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:38.011136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:38.046999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:38.047963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:38.048469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:38.049052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:38.050108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] RBAC: Adding query filter params (interface=public, service_id=c2210b370fef4f5386089e876ee56e96, region_id=RegionOne) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:38.050618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:38.052316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:38.058392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 522/1029] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:03:37 2022] GET /identity/v3/endpoints?service_id=c2210b370fef4f5386089e876ee56e96&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:38.063799 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:38.069537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac3dfa-0e43-43f0-b9aa-85686224e6da None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:38.105125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd68c9f-960c-44e7-b41e-639045e01d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:38.105791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd68c9f-960c-44e7-b41e-639045e01d56 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:38.106033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd68c9f-960c-44e7-b41e-639045e01d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:38.106307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd68c9f-960c-44e7-b41e-639045e01d56 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:38.106951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd68c9f-960c-44e7-b41e-639045e01d56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:38.108376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd68c9f-960c-44e7-b41e-639045e01d56 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:38.140683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 508/1030] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:03:37 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:03:38.177152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25be951-63e2-41df-b8e1-1a593149da18 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:38.215963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312830d7-e9db-464f-9b2c-82ed6b5a3723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:38.216560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312830d7-e9db-464f-9b2c-82ed6b5a3723 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:38.216845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312830d7-e9db-464f-9b2c-82ed6b5a3723 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:38.217117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312830d7-e9db-464f-9b2c-82ed6b5a3723 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:38.217769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312830d7-e9db-464f-9b2c-82ed6b5a3723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:38.219150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312830d7-e9db-464f-9b2c-82ed6b5a3723 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:38.226680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 523/1031] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:03:38 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:03:38.760031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332320-a5dd-4d7e-ab07-59259eb1b6db None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:38.760398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332320-a5dd-4d7e-ab07-59259eb1b6db None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:38.760656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57332320-a5dd-4d7e-ab07-59259eb1b6db None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:38.762076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 509/1032] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:38.768022 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:38.768478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:38.768689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:38.790051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:38.791281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:38.821453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:38.864734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 524/1033] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:39.134191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332320-a5dd-4d7e-ab07-59259eb1b6db None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:39.225822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:39.245892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57332320-a5dd-4d7e-ab07-59259eb1b6db None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:39.282532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:39.283405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:39.283864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:39.284281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:39.296158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:39.301165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:39.302235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:39.303221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:39.303903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 510/1034] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:39.309745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:39.416133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7771fb3-4a98-4a16-bdcc-ad7cbdae7f3c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:39.449480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:39.450115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:39.450394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:39.450660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:39.451312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:39.451610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:39.452941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:39.461741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 525/1035] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:39.467167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:39.570372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920a42e-469b-4282-9df4-a9fc1016aca6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:39.604469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:39.605093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:39.605369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:39.605637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:39.616549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:39.618070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:39.624350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:39.634637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:39.635574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:39.636497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:39.636497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:39.636497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:39.638039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 511/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:39.641640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:39.668731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:39.746001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c1ca42-6b51-44b4-b17a-f5fe60e539da None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:39.781234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:39.781891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:39.782139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:39.782410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:39.783053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:39.783354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:39.784702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:39.801947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 526/1037] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:39.803270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:39.908770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd2705-296c-454f-b879-f94c82074ff2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:39.948084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:39.948711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:39.948990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:39.949260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:39.956996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:39.958458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:39.970017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:39.970995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:39.977109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 512/1038] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:39.977816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.065134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.083058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a12af-60e1-49a5-98af-449db6932ae8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.118877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.119541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.119827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.120100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.120848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:40.121134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:40.122590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417e7cc-5768-40a2-85de-626d37f00d5a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:40.145814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 527/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:03:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:40.147161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.180822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eec97-fa6d-4e52-ab81-bb299e8cf716 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.181102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eec97-fa6d-4e52-ab81-bb299e8cf716 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.181539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942eec97-fa6d-4e52-ab81-bb299e8cf716 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.182779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 528/1040] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:40.187863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ca135-d852-4e15-99bf-5cab36f8bd6e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.188146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ca135-d852-4e15-99bf-5cab36f8bd6e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.188420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ca135-d852-4e15-99bf-5cab36f8bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.207634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-419ca135-d852-4e15-99bf-5cab36f8bd6e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:40.208756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-419ca135-d852-4e15-99bf-5cab36f8bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:40.211695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.258286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cec1f-7f59-4e62-ad22-4777fb83b882 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.275972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 529/1041] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:40.277286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf666a-48b7-4ab6-b354-85d5d91e53d8 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.277578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf666a-48b7-4ab6-b354-85d5d91e53d8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.277869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf666a-48b7-4ab6-b354-85d5d91e53d8 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.279296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 530/1042] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:40.287131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.287945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.288233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.297440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.298084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.298365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.298637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.306663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:40.307860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:40.370899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:40.372350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:40.376420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 531/1043] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:40.432519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.481276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 513/1044] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:40.482686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.485314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.546948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.587073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43dc901-ce6f-47f1-8b88-8eae54f80585 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.623572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.624561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.625063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.625345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.635888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:40.637321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:40.649440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6be0ee-0ef1-49c5-8013-81b45397a2a8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:40.652573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:40.653520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:40.654487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:40.654487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:40.654487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:40.654487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 532/1045] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:40.654487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.684582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.685143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.685428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.685700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.695640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:40.700413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:40.701537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:40.702464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 514/1046] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:40.703168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.712533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.721911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.758302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d099b-90e2-43b0-a6e3-7a80ca0ceb14 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.792529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.793227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.793443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.793737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] PATH_INFO: `/v3/services/image` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.794392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:40.795734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:40.803726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea365b3-7e4e-4cea-b420-60180a12b95b None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:40.804469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:40.805458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:40.806331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 533/1047] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:40.807125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.841610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.842334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.842676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.843010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.843709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:40.844077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:40.845489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:40.857775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 515/1048] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:40.858566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.909792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148c35c-76a6-4617-af76-75b1b4cc2a69 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:40.932639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.941650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:40.951090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:40.951090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:40.951364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:40.951528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:40.952198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:40.952508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:40.953922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:40.963677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 534/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:40.964503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:40.965085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5695ca9-bb0b-46f5-9b5c-4b7635fefbf8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.000628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.001236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.001520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.001830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.002463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] RBAC: Adding query filter params (name=image) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:41.002767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.004133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.010569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 516/1050] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:41.011274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.069609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68268fa-02b5-4b61-b456-ec309dfbb35e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.105222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.105933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.106211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.106485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.109160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3edfe-54ba-4747-b9b6-56da2ff504f7 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.112976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.114427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:41.125872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:41.126859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:41.127747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 535/1051] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:41.128225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.147855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.148567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.148848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.149119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] PATH_INFO: `/v3/users/7c9727e2b5174867a0e114301cf87e21` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.160681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:41.163705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9727e2b5174867a0e114301cf87e21)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.165914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.172039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 517/1052] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/users/7c9727e2b5174867a0e114301cf87e21 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:41.172039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.174723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:41.233806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad07a5e-d9e0-4d4a-a736-1a273ef50066 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.268009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.268205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09597d-5bc7-43ec-bbaf-4ec059ef9775 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.268613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.268894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.269164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.269818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] RBAC: Adding query filter params (type=image) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:41.270259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.271607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.276502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 536/1053] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:41.277368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.303226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.304710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.304994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.305266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.305988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:41.306296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.307713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.318987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 518/1054] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:41.319889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.380424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e363c0-d9da-4842-b2a9-bf55a4058143 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.380944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:41.382926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:41.415490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.416091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.416370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.416646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.424873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17eb09-b89b-4d89-a0fb-94157d87969e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.457608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.458250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.458528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.458803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.459962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.461311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.481578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 519/1055] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:03:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:41.482448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.491212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.492883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.614802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 537/1056] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:41.620948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.622511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b1b1e-2c4c-4217-ae48-6ce2d3a16d2d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.625987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:41.636751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:41.668739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.669355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.669631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.669945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.670680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] RBAC: Adding query filter params (role.id=4e11960ddd0842baa576b812a0aa532b, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=118462014bfa41e388b6bb0be1d208d0) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:41.670991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.672519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.678854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 520/1057] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/role_assignments?user.id=118462014bfa41e388b6bb0be1d208d0&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=4e11960ddd0842baa576b812a0aa532b => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:41.739874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c027a75a-d404-4dfb-a639-d331224fe69f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.779242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e2bb-a5f2-41d0-ae55-6016d9c83773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.779802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e2bb-a5f2-41d0-ae55-6016d9c83773 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.780087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e2bb-a5f2-41d0-ae55-6016d9c83773 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.780364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e2bb-a5f2-41d0-ae55-6016d9c83773 None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.781523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405e2bb-a5f2-41d0-ae55-6016d9c83773 None admin] RBAC: Authorizing `identity:get_project(project_id=c2723c182eee4afda361ef3629d6a6f1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.783016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405e2bb-a5f2-41d0-ae55-6016d9c83773 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.784894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 538/1058] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:41.791213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:41.898178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41350717-2978-4f3a-84e6-dd40c052860c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:41.941279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:41.942091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:41.942377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:41.942647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:41.943373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=c2723c182eee4afda361ef3629d6a6f1, user.id=7c9727e2b5174867a0e114301cf87e21) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:41.944184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:41.946129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6093deaa-ec15-4139-a93c-fffe33bcd538 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:41.956917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 521/1059] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:41 2022] GET /identity/v3/role_assignments?user.id=7c9727e2b5174867a0e114301cf87e21&scope.project.id=c2723c182eee4afda361ef3629d6a6f1&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:43.511731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6822-2d71-4b2e-bbfa-f766d7e7358f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:43.512256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6822-2d71-4b2e-bbfa-f766d7e7358f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:43.512256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a6822-2d71-4b2e-bbfa-f766d7e7358f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:43.513649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 539/1060] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:43.518910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a899c-35a8-4625-afbc-2dff3642ffc2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:43.519326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a899c-35a8-4625-afbc-2dff3642ffc2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:43.519492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02a899c-35a8-4625-afbc-2dff3642ffc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:43.539134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c02a899c-35a8-4625-afbc-2dff3642ffc2 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:43.540676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c02a899c-35a8-4625-afbc-2dff3642ffc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:43.577248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:43.583108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3095bd-de60-433c-8a7f-bab9607e447c None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:43.583406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3095bd-de60-433c-8a7f-bab9607e447c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:43.583689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3095bd-de60-433c-8a7f-bab9607e447c None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:43.586036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 540/1061] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:43.591048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509be818-5bc2-4a19-9a95-8c64d4377930 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:43.591334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509be818-5bc2-4a19-9a95-8c64d4377930 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:43.591608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509be818-5bc2-4a19-9a95-8c64d4377930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:43.610925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-509be818-5bc2-4a19-9a95-8c64d4377930 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:43.612141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-509be818-5bc2-4a19-9a95-8c64d4377930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:43.616486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 522/1062] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:43.683170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 541/1063] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:43.831821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a6bb-e85c-49d0-81c5-9b66637523f9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:43.832114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a6bb-e85c-49d0-81c5-9b66637523f9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:43.832294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a6bb-e85c-49d0-81c5-9b66637523f9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:43.833819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 523/1064] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:43.838862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:43.839151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:43.839423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:43.845548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:43.858974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:43.860149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:43.890364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a6bb-e85c-49d0-81c5-9b66637523f9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:43.933976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 542/1065] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:43.954077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.012341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a6bb-e85c-49d0-81c5-9b66637523f9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.047172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.047778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.048060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.048336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.059528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96d8744-d0a0-4205-be0d-36bb308c3254 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.088982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.089157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.095901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.096526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.096803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.097074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.107846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:44.112530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:44.113423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:44.114310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 543/1066] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 00:03:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:44.120061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.128054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.130051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.227036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00046a5-0758-43d8-aa03-8c15c2e58487 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.249793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 524/1067] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 30 00:03:44.249793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.267441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.268053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.268342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.268619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.269285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:44.269590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.271013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.279039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 544/1068] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:44.279890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.319164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.339534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.351442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16246096-fe30-481b-8e7d-e3860eacb71f None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.385503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc468d5-7f2d-4900-abf3-eb436a512901 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.386045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.386664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.386955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.387224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.397564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:44.402424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:44.403352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:44.404181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 525/1069] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:44.404853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.423067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.423910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.424191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.424466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.434903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.436324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:44.450209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:44.451319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:44.452381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:44.452381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:44.452381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:44.452381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 545/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:44.452381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.510851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe60fd-0244-4014-b53c-cce8f5fc4c66 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.539827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.546447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.547073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.547357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.547639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.554239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05f9a1-002b-4e99-b34b-72ad8b5fb869 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.558245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.559725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.561380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:44.574916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:44.576074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:44.576996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:44.576996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:44.576996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:44.576996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 526/1071] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:44.576996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.594676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.595222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.595514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.595795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.596461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:44.596768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.598165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.607588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 546/1072] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:44.608308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.682715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b8ada-29a4-4e9f-86cb-1760b0aeb883 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.707486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e9c7a4-e138-423d-96b2-d5d614d04b36 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.716879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.717485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.717797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.718080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.718726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:44.719031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.720399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.732427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 527/1073] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:44.733218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.745160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.746146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.746450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.746730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.747415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:44.747732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.749151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.767247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 547/1074] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:44.768515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.789890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.799999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:44.862863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db101f5-439b-4ff2-afc2-55c09aef2c11 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.882489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce78ca-f4e9-405e-9c1c-d20f7447ba20 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:44.907517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.908436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.908733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.909018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] PATH_INFO: `/v3/users/7c9727e2b5174867a0e114301cf87e21` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.910716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9727e2b5174867a0e114301cf87e21)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.913216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.916346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 528/1075] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/users/7c9727e2b5174867a0e114301cf87e21 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:44.922271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:44.922696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:44.923372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:44.924126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:44.924407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:44.933984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:44.935867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:44.948129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:44.949101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:44.950146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 548/1076] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:44.955171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.045017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae71459-9973-4540-a419-ae3cc1014ac2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.055193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:45.057283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:45.068394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c32c0f-9946-41a4-a008-98d77bc46e1f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.080835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.081451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.081755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.082032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.083137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] RBAC: Authorizing `identity:get_project(project_id=c2723c182eee4afda361ef3629d6a6f1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.084558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.086303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 529/1077] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:45.092198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.102202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.102806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.103091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.103364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.104088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:45.104399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.105837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.123703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 549/1078] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:03:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:45.128994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.195449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1475d-8fec-408c-a719-352b8a1ce106 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.227334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac08c3b-7c80-4c95-8029-3627aacc030f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.230404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.231054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.231335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.231610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1/users/7c9727e2b5174867a0e114301cf87e21/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.233507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2723c182eee4afda361ef3629d6a6f1, user_id=7c9727e2b5174867a0e114301cf87e21, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.234981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.247632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 530/1079] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:45 2022] PUT /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1/users/7c9727e2b5174867a0e114301cf87e21/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:03:45.263163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.263818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.264128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.264406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.276638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.278138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.285843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:45.295693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:45.296734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:45.297650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:45.297650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:45.297650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:45.297650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 550/1080] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:45.303085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.345205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:45.408919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ed0bf0-c544-421e-a800-696b1c0df647 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.443062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.443712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.444090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.444394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.444998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:45.445307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.446716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.458010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 531/1081] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:45.464504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.563655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822ffd-f09f-427c-8e8d-8c08ba4b3260 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.597606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.598258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.598539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.598812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.605350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.606800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:45.618042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:45.618907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:45.619809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 551/1082] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:45.625049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.723524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:45.728306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b3bb1d-eda4-4a9e-89f1-7853fed13ece None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.762256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.762861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.763167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.763445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.764133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:45.764444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.765896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae99291-ebf0-4077-abb6-e753bca7b8b1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.777849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 532/1083] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:45.784102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:45.842934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:45.887031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a2cdd-0ace-4664-b708-edac6d15065b None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:45.925597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d33edf-4919-4273-81b3-4fde78ae3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:45.926285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d33edf-4919-4273-81b3-4fde78ae3ecc None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:45.926566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d33edf-4919-4273-81b3-4fde78ae3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:45.926838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d33edf-4919-4273-81b3-4fde78ae3ecc None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/118462014bfa41e388b6bb0be1d208d0/roles/4e11960ddd0842baa576b812a0aa532b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:45.929876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d33edf-4919-4273-81b3-4fde78ae3ecc None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=118462014bfa41e388b6bb0be1d208d0, role_id=4e11960ddd0842baa576b812a0aa532b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:45.931295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d33edf-4919-4273-81b3-4fde78ae3ecc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:45.944961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 552/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:45 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/118462014bfa41e388b6bb0be1d208d0/roles/4e11960ddd0842baa576b812a0aa532b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:47.137488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6696-d74d-43ef-b499-3ef7784b8c40 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.138033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6696-d74d-43ef-b499-3ef7784b8c40 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.138157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e6696-d74d-43ef-b499-3ef7784b8c40 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.139432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 533/1085] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:47.144606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.145048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.145332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.164542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:47.165750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:47.231407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 553/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:47.502366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e6696-d74d-43ef-b499-3ef7784b8c40 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:47.602051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e6696-d74d-43ef-b499-3ef7784b8c40 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:47.636363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:47.636982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.637263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.637536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.647422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:47.652160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:47.653206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:03:47.654150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:47.657857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 534/1087] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:03:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:47.659264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:47.708788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:47.762272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a5836-1e5e-4610-8bfd-db35d936090a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:47.795293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:47.795887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.796185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.796462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.797121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:47.797420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:47.798817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe743fa1-1bae-4db3-8f47-6c4de359a2a2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:47.807594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 554/1088] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:03:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:47.813119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:47.831966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:47.855013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5298-8304-47a8-b92c-128d65432eb4 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.855294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5298-8304-47a8-b92c-128d65432eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.855561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf5298-8304-47a8-b92c-128d65432eb4 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.856887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 555/1089] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:03:47.862434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.862726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.863004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.881921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:47.883231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:47.914889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5745f-b780-4cbe-bf73-98719fe1a6cc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:47.952488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:47.952749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 556/1090] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:47.953109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:47.953392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:47.953666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] PATH_INFO: `/v3/users/7c9727e2b5174867a0e114301cf87e21` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:47.954823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] RBAC: Authorizing `identity:get_user(user_id=7c9727e2b5174867a0e114301cf87e21)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:47.956248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:47.963586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 535/1091] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:47 2022] GET /identity/v3/users/7c9727e2b5174867a0e114301cf87e21 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:47.966725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.008841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.066188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfadbe5-7e44-4f0f-974a-6a5b59f94a91 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.099155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.099753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.100589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.100896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.168886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:48.170358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:48.210097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.217595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.269454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 557/1092] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:48.276280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.304455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.319734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4de623-002c-4364-9fed-7f864999c057 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.354083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.354699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.354979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.355251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.364879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:03:48.369765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:48.370707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:48.372160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 536/1093] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:48.375757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435a30b6-5205-44ac-b48e-18c223b31046 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.376648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.410158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.410781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.411062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.411335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.412521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] RBAC: Authorizing `identity:get_project(project_id=c2723c182eee4afda361ef3629d6a6f1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:48.414842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:48.421852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 558/1094] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:48.422869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.434123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.479512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463ba74-f9e2-4cc5-8789-cb59988748f3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.513295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.514026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.514305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.514572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.515228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:48.515532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:48.516884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:48.525233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 537/1095] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:48.526569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b7c67-a233-4141-95f6-6fd908b6ea16 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.530770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.541273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.560524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.561123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.561398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.561672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.562419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=c2723c182eee4afda361ef3629d6a6f1, user.id=7c9727e2b5174867a0e114301cf87e21) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:48.562729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:48.564126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:48.572676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 559/1096] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/role_assignments?user.id=7c9727e2b5174867a0e114301cf87e21&scope.project.id=c2723c182eee4afda361ef3629d6a6f1&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:03:48.638686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49728e7a-3489-4b82-9474-8e7f5add8cbc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.674111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.674757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.675041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.675315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.687832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:48.689300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:48.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:48.708291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:48.709409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:48.709409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:48.709409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:48.709409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 538/1097] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:48.712143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.784218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.815384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2fe90-4832-456f-85a4-6c3a8cd4b503 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:48.848611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:48.849137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:48.849415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:48.849685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:48.851278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:48.851587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:48.852937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:48.865146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 560/1098] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:48.871550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:48.934126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:48.976751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831afbc-4bb2-4263-a6d3-32cbf2e3cce4 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:49.011250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:49.011868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:49.012147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:49.012413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:49.019779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:49.021209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:03:49.033043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:49.034212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:03:49.035759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 539/1099] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Aug 30 00:03:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:49.040750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:49.140458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10deff83-40c2-4c00-baeb-72948744e9ea None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:49.170056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:49.175654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:49.176261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:49.176546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:49.176824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:49.177552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:49.177890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:49.179374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:49.196399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 561/1100] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Aug 30 00:03:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:49.202520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:49.305813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d07a6-9237-4ee1-bff0-bb0c3a8789c3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:49.325633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:49.340487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:49.341087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:49.341370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:49.341645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:49.407073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:49.408455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:49.503582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 540/1101] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:49.510150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:49.608076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e343af-b5cb-4bc1-a282-ad8053dca546 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:49.642516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:49.643139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:49.643427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:49.643699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:49.653685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:49.655138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:03:49.669637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:49.670731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:03:49.671987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:03:49.671987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:03:49.671987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:49.671987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 562/1102] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:03:49.676668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:49.699425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:49.777036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d74221c-39eb-40e2-ac7b-603eb56a8cd0 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:49.810703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:49.811302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:49.811588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:49.811863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:49.812506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:49.812814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:49.814221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:49.825773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 541/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:49.831473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:49.874322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:49.934792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06233ddd-1abe-41d2-a785-d0afa9d713f8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:49.968585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:49.969203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:49.969482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:49.969775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:49.976781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:49.978229 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:03:49.989157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:03:49.990324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:03:49.992199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 563/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:03:49.997852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:50.076296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:50.095644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bade424-2915-44ab-9ccb-2bb048e5ae36 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:50.129477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:50.130105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:50.130382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:50.130911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:50.131981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:50.132513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:50.134383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8025b-2f95-4bf7-bf28-5b97102b5a8b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:50.146334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 542/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:50.152564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:50.252259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf15270-b868-44aa-b6d2-b924ceb3a354 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:50.253689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:50.286810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2856b563-210e-435a-8bef-41b852df086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:50.287919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b563-210e-435a-8bef-41b852df086c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:50.288197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b563-210e-435a-8bef-41b852df086c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:50.288470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856b563-210e-435a-8bef-41b852df086c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:50.289197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856b563-210e-435a-8bef-41b852df086c None admin] RBAC: Adding query filter params (role.id=4e11960ddd0842baa576b812a0aa532b, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=118462014bfa41e388b6bb0be1d208d0) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:50.289507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856b563-210e-435a-8bef-41b852df086c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:50.290968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2856b563-210e-435a-8bef-41b852df086c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:50.296674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 564/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:50 2022] GET /identity/v3/role_assignments?user.id=118462014bfa41e388b6bb0be1d208d0&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=4e11960ddd0842baa576b812a0aa532b => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:50.528798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6374-6546-41d8-95a8-e0f88eb79251 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:50.538539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6374-6546-41d8-95a8-e0f88eb79251 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:50.538539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d6374-6546-41d8-95a8-e0f88eb79251 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:50.538539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 543/1107] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:50.539851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:50.540147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:50.540453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:50.561437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:50.562676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:50.631960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 565/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:50.906554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d6374-6546-41d8-95a8-e0f88eb79251 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:51.012848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d6374-6546-41d8-95a8-e0f88eb79251 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:51.054540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c5e35-8af2-4dbe-b464-8d731e4c24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:51.055181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5e35-8af2-4dbe-b464-8d731e4c24ab None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:51.055468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5e35-8af2-4dbe-b464-8d731e4c24ab None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:51.055743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c5e35-8af2-4dbe-b464-8d731e4c24ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:51.056879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c5e35-8af2-4dbe-b464-8d731e4c24ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:51.058356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c5e35-8af2-4dbe-b464-8d731e4c24ab None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:51.060088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 544/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:51.066016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:51.166654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:51.173178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7445ee-bc56-40cd-8d7d-c062276272e0 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:51.207557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a2488-4a32-4000-9ef0-40a082ac5bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:51.208154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2488-4a32-4000-9ef0-40a082ac5bfb None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:51.208437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2488-4a32-4000-9ef0-40a082ac5bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:51.208714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a2488-4a32-4000-9ef0-40a082ac5bfb None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:51.209412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2488-4a32-4000-9ef0-40a082ac5bfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:51.210972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a2488-4a32-4000-9ef0-40a082ac5bfb None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:51.232058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 566/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:03:51 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:03:53.195655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9882-a82d-47ea-9205-e3987c8818f1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:53.196198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9882-a82d-47ea-9205-e3987c8818f1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:53.196198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee9882-a82d-47ea-9205-e3987c8818f1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:53.197451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 545/1111] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:53.202606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:53.203041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:53.203143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:53.221012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:53.222218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:53.289429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 567/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:53.563840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9882-a82d-47ea-9205-e3987c8818f1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:53.574550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:53.665029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee9882-a82d-47ea-9205-e3987c8818f1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:53.697917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:53.698531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:53.698811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:53.699084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] PATH_INFO: `/v3/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:53.700471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] RBAC: Authorizing `identity:get_role(role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:53.701952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:53.703271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 546/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:53 2022] GET /identity/v3/roles/ca37184ac9034a398797d8994e2ce144 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:53.709075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:53.789315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:53.807409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fea7c-7567-4ca5-9c76-a9e93feeb5bc None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:53.840790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:53.841339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:53.841622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:53.841922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] PATH_INFO: `/v3/users/6dfd54d3b5dd4807a7be9d814d60dd65` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:53.854602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] RBAC: Authorizing `identity:get_user(user_id=6dfd54d3b5dd4807a7be9d814d60dd65)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:53.856013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:53.857599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 568/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:53 2022] GET /identity/v3/users/6dfd54d3b5dd4807a7be9d814d60dd65 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:53.863480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:53.940865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:53.964363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469affa2-23c1-4c76-81aa-bf846f15751d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:53.996682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:53.997281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:53.997560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:53.997862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:54.062910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:54.064341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:54.136842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:54.159557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 547/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:03:54.165945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:54.264781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7423bd-ab0a-42fa-9ff9-d3fbe01438fc None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:54.297535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff275a-07dd-4bd8-a4dc-6344f10e6348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:54.298191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff275a-07dd-4bd8-a4dc-6344f10e6348 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:54.298478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff275a-07dd-4bd8-a4dc-6344f10e6348 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:54.298752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff275a-07dd-4bd8-a4dc-6344f10e6348 None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:54.299865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff275a-07dd-4bd8-a4dc-6344f10e6348 None admin] RBAC: Authorizing `identity:get_project(project_id=c2723c182eee4afda361ef3629d6a6f1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:54.301280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff275a-07dd-4bd8-a4dc-6344f10e6348 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:54.303468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 569/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:03:54 2022] GET /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:54.309657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:54.406238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22726d02-c461-4dc0-8396-e6045df2eb78 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:54.439146 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:54.439735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:54.440014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:54.440286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:54.441011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] RBAC: Adding query filter params (role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=c2723c182eee4afda361ef3629d6a6f1, user.id=6dfd54d3b5dd4807a7be9d814d60dd65) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:03:54.441318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:54.442900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f84e4-18f7-4398-a5b3-9ed3e013080f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:54.448628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 548/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:03:54 2022] GET /identity/v3/role_assignments?user.id=6dfd54d3b5dd4807a7be9d814d60dd65&scope.project.id=c2723c182eee4afda361ef3629d6a6f1&role.id=ca37184ac9034a398797d8994e2ce144 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:56.312113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378687-8b9e-41d2-b2af-173f3230a367 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:56.312622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378687-8b9e-41d2-b2af-173f3230a367 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:56.312622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d378687-8b9e-41d2-b2af-173f3230a367 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:56.313953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 570/1118] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:56.319534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:56.319939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:56.320081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:56.338412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:56.339588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:56.373128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:56.406528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 549/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:03:56.668699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d378687-8b9e-41d2-b2af-173f3230a367 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:56.680256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:56.767873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d378687-8b9e-41d2-b2af-173f3230a367 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:56.801397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:56.802031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:56.802309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:56.802580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] PATH_INFO: `/v3/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:56.804713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] RBAC: Authorizing `identity:get_role(role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:56.806081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:56.807387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 571/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:56 2022] GET /identity/v3/roles/ca37184ac9034a398797d8994e2ce144 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:56.813215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:56.909575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6959fcf-56e6-4f1d-a0d9-3aa311db41a1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:56.944716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:56.945272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:56.945554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:56.945871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] PATH_INFO: `/v3/users/6dfd54d3b5dd4807a7be9d814d60dd65` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:56.946986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] RBAC: Authorizing `identity:get_user(user_id=6dfd54d3b5dd4807a7be9d814d60dd65)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:56.948419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:56.950034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 550/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:56 2022] GET /identity/v3/users/6dfd54d3b5dd4807a7be9d814d60dd65 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:56.955735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:57.031077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:57.061038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959261d5-1b38-48b3-b9ce-85bec704dbd6 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:57.095804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca9cc1-208e-42fb-8fff-b8a74481f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:57.096428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca9cc1-208e-42fb-8fff-b8a74481f5dd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:57.096710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca9cc1-208e-42fb-8fff-b8a74481f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:57.096984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca9cc1-208e-42fb-8fff-b8a74481f5dd None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:57.098134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca9cc1-208e-42fb-8fff-b8a74481f5dd None admin] RBAC: Authorizing `identity:get_project(project_id=c2723c182eee4afda361ef3629d6a6f1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:57.099552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca9cc1-208e-42fb-8fff-b8a74481f5dd None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:57.101872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 572/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:03:56 2022] GET /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:57.107786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:57.147903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:57.206832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9cb7c-cbfd-4102-84e5-665306e31544 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:57.241096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa33e3-4922-42ba-9f83-cd8f64e8c88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:57.241752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa33e3-4922-42ba-9f83-cd8f64e8c88d None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:57.242036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa33e3-4922-42ba-9f83-cd8f64e8c88d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:57.242308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa33e3-4922-42ba-9f83-cd8f64e8c88d None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1/users/6dfd54d3b5dd4807a7be9d814d60dd65/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:57.244404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa33e3-4922-42ba-9f83-cd8f64e8c88d None admin] RBAC: Authorizing `identity:create_grant(project_id=c2723c182eee4afda361ef3629d6a6f1, user_id=6dfd54d3b5dd4807a7be9d814d60dd65, role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:57.245844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa33e3-4922-42ba-9f83-cd8f64e8c88d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:57.258433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 551/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:03:57 2022] PUT /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1/users/6dfd54d3b5dd4807a7be9d814d60dd65/roles/ca37184ac9034a398797d8994e2ce144 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:03:59.149258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657f44e-99a7-4b21-b95d-617c889b1673 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:59.149811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657f44e-99a7-4b21-b95d-617c889b1673 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:59.149811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657f44e-99a7-4b21-b95d-617c889b1673 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:59.151177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 573/1124] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:03:59.156317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:59.156750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:59.156848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:59.174769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:03:59.175857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:03:59.239310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 552/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:03:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:03:59.510483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657f44e-99a7-4b21-b95d-617c889b1673 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:59.609205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657f44e-99a7-4b21-b95d-617c889b1673 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:59.642080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:59.642696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:59.642976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:59.643251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] PATH_INFO: `/v3/roles/ca37184ac9034a398797d8994e2ce144` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:59.644626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] RBAC: Authorizing `identity:get_role(role_id=ca37184ac9034a398797d8994e2ce144)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:59.646012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:59.647987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 574/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:59 2022] GET /identity/v3/roles/ca37184ac9034a398797d8994e2ce144 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:59.654036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:59.681049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:59.750806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e560a3-c07e-4270-af47-76f04a0f1472 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:59.784543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:59.785095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:59.785376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:59.785650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] PATH_INFO: `/v3/users/6dfd54d3b5dd4807a7be9d814d60dd65` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:59.786793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] RBAC: Authorizing `identity:get_user(user_id=6dfd54d3b5dd4807a7be9d814d60dd65)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:59.788264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:03:59.789849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 553/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:03:59 2022] GET /identity/v3/users/6dfd54d3b5dd4807a7be9d814d60dd65 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:03:59.795735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:03:59.810257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:03:59.893856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dd614c-3e5b-4db7-870f-bc52c31a2548 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:03:59.927620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:03:59.928300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:03:59.928580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:03:59.928854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:03:59.994614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:03:59.996040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:00.009973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:00.093540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 575/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:03:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:00.099682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:00.192298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:00.199028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d80109-0efa-4301-b006-eed4e1de9117 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:00.231849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a324d-8c42-4a4d-9bd1-ad72f0a4bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:00.232466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a324d-8c42-4a4d-9bd1-ad72f0a4bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:00.232752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a324d-8c42-4a4d-9bd1-ad72f0a4bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:00.233026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a324d-8c42-4a4d-9bd1-ad72f0a4bfe5 None admin] PATH_INFO: `/v3/projects/c2723c182eee4afda361ef3629d6a6f1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:00.234174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a324d-8c42-4a4d-9bd1-ad72f0a4bfe5 None admin] RBAC: Authorizing `identity:get_project(project_id=c2723c182eee4afda361ef3629d6a6f1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:00.235612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a324d-8c42-4a4d-9bd1-ad72f0a4bfe5 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:00.237234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 554/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:00 2022] GET /identity/v3/projects/c2723c182eee4afda361ef3629d6a6f1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:00.244300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:00.340899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32ff409-2024-4c29-b9aa-b423e8e5179e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:00.353640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:00.375589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:00.376188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:00.376473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:00.376750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:00.377473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] RBAC: Adding query filter params (role.id=ca37184ac9034a398797d8994e2ce144, scope.project.id=c2723c182eee4afda361ef3629d6a6f1, user.id=6dfd54d3b5dd4807a7be9d814d60dd65) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:00.377892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:00.379329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d992a8f-3d3d-4a70-8770-2bfb5fa7292d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:00.386098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 576/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:04:00 2022] GET /identity/v3/role_assignments?user.id=6dfd54d3b5dd4807a7be9d814d60dd65&scope.project.id=c2723c182eee4afda361ef3629d6a6f1&role.id=ca37184ac9034a398797d8994e2ce144 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:04:02.290586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae145-e285-4f30-9db5-d3683d02832d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:02.291122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae145-e285-4f30-9db5-d3683d02832d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:02.291122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92ae145-e285-4f30-9db5-d3683d02832d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:02.292401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 555/1131] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:02.297669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:02.298078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:02.298259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:02.317348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:02.318701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:02.384139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 577/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:02.650272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ae145-e285-4f30-9db5-d3683d02832d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:02.749645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92ae145-e285-4f30-9db5-d3683d02832d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:02.783344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1683c-3537-44e0-89d9-540853c85dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:02.783954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1683c-3537-44e0-89d9-540853c85dad None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:02.784239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1683c-3537-44e0-89d9-540853c85dad None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:02.784514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1683c-3537-44e0-89d9-540853c85dad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:02.785630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1683c-3537-44e0-89d9-540853c85dad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:02.787077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1683c-3537-44e0-89d9-540853c85dad None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:02.788637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 556/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:04:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:02.794537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:02.890242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e8cf9-49a2-4434-80b1-fb5b0c496939 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:02.898088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:02.926321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473310d8-a2c1-4fca-ab24-61da1fc36d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:02.926927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473310d8-a2c1-4fca-ab24-61da1fc36d32 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:02.927211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473310d8-a2c1-4fca-ab24-61da1fc36d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:02.927486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473310d8-a2c1-4fca-ab24-61da1fc36d32 None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:02.928276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473310d8-a2c1-4fca-ab24-61da1fc36d32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:02.929720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473310d8-a2c1-4fca-ab24-61da1fc36d32 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:02.956209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 578/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:04:02 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:04:04.857589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af69ae-49fb-4eea-8536-75e891a893d2 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:04.858269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af69ae-49fb-4eea-8536-75e891a893d2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:04.858269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af69ae-49fb-4eea-8536-75e891a893d2 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:04.859592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 557/1135] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:04.864787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:04.865178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:04.865338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:04.883532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:04.884715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:04.951929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 579/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:05.227868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af69ae-49fb-4eea-8536-75e891a893d2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:05.259196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:05.328941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af69ae-49fb-4eea-8536-75e891a893d2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:05.362434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b031c1c-208b-4222-81d2-724ea05290ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:05.363060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031c1c-208b-4222-81d2-724ea05290ba None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:05.363329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031c1c-208b-4222-81d2-724ea05290ba None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:05.363599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b031c1c-208b-4222-81d2-724ea05290ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:05.364693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b031c1c-208b-4222-81d2-724ea05290ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:05.366836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b031c1c-208b-4222-81d2-724ea05290ba None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:05.368389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 558/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:05.374280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:05.459186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:05.471496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0060ed-5e83-4b19-9491-8720e5580e85 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:05.505551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26ce1-4e12-4bb6-ad12-428f578aee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:05.506918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26ce1-4e12-4bb6-ad12-428f578aee48 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:05.507247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26ce1-4e12-4bb6-ad12-428f578aee48 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:05.507594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26ce1-4e12-4bb6-ad12-428f578aee48 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:05.508347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26ce1-4e12-4bb6-ad12-428f578aee48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:05.509723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26ce1-4e12-4bb6-ad12-428f578aee48 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:05.530190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 580/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:04:05 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:04:07.508822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff201fc-1cf3-4664-a65a-6665d70ffd0f None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:07.509362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff201fc-1cf3-4664-a65a-6665d70ffd0f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:07.509362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff201fc-1cf3-4664-a65a-6665d70ffd0f None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:07.510733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 559/1139] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:07.515839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:07.516254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:07.516391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:07.534936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:07.536117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:07.601104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 581/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:07.871863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff201fc-1cf3-4664-a65a-6665d70ffd0f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:07.968473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:07.972523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff201fc-1cf3-4664-a65a-6665d70ffd0f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:08.007631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:08.008310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:08.008589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:08.008859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:08.018630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:04:08.023506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:08.024647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:04:08.025785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 560/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:04:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:08.030601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:08.102975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:08.128175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18c72f-db6d-44fd-bbe8-3bf9a53d680f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:08.161480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:08.162095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:08.163039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:08.163336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:08.164015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:08.164567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:08.165671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:08.173469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 582/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:08.179849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:08.280004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca8ace-6a29-4af7-a1ae-bd1bdfef2479 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:08.313627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:08.314267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:08.314552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:08.314823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] PATH_INFO: `/v3/users/ec092960524f40cf858bc27c86649d48` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:08.327996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] RBAC: Authorizing `identity:get_user(user_id=ec092960524f40cf858bc27c86649d48)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:08.329447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:08.331127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 561/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:04:08 2022] GET /identity/v3/users/ec092960524f40cf858bc27c86649d48 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:08.337285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:08.436717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4874fc8f-35ea-4de5-8448-93fef3feeb8d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:08.469250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:08.469872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:08.470158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:08.470428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:08.473689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:08.536810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:08.539097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:08.636761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 583/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:04:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:08.642714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:08.661725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:08.739567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5024af38-cbe4-4789-bddc-3dba2ea1540c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:08.776925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b44f5d-8a34-43d6-93cc-36bea80a28e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:08.777543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b44f5d-8a34-43d6-93cc-36bea80a28e0 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:08.777853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b44f5d-8a34-43d6-93cc-36bea80a28e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:08.778125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b44f5d-8a34-43d6-93cc-36bea80a28e0 None admin] PATH_INFO: `/v3/projects/0b4659ec259e4e28b55e39a80fdfb178` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:08.779228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b44f5d-8a34-43d6-93cc-36bea80a28e0 None admin] RBAC: Authorizing `identity:get_project(project_id=0b4659ec259e4e28b55e39a80fdfb178)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:08.780653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b44f5d-8a34-43d6-93cc-36bea80a28e0 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:08.782307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 562/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:08 2022] GET /identity/v3/projects/0b4659ec259e4e28b55e39a80fdfb178 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:08.788522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:08.823836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:08.886881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f4766d-9610-478f-b6b0-0e9c6b447ce9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:08.919922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:08.920514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:08.920791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:08.921060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:08.921806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=0b4659ec259e4e28b55e39a80fdfb178, user.id=ec092960524f40cf858bc27c86649d48) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:08.922114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:08.923518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2658b-d32a-4c9d-9598-99d913b98e6f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:08.928888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 584/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:04:08 2022] GET /identity/v3/role_assignments?user.id=ec092960524f40cf858bc27c86649d48&scope.project.id=0b4659ec259e4e28b55e39a80fdfb178&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:10.799535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ce7b-5316-4dc3-9754-14f2a8a4adf1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:10.800086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ce7b-5316-4dc3-9754-14f2a8a4adf1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:10.800086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15ce7b-5316-4dc3-9754-14f2a8a4adf1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:10.801417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 563/1147] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:10.807105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:10.807528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:10.807657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:10.826361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:10.827558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:10.893188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 585/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:11.157047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ce7b-5316-4dc3-9754-14f2a8a4adf1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:11.241807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:11.258407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15ce7b-5316-4dc3-9754-14f2a8a4adf1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:11.292384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:11.292994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:11.293274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:11.293544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:11.304350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:04:11.309077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:11.310186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:04:11.311207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 564/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:04:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:11.316234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:11.345305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:11.414718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf6731-1a7a-404c-bbfe-335834931ff9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:11.447663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:11.448263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:11.448548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:11.448824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:11.449484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:11.449818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:11.451173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:11.458975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 586/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:04:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:11.465250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:11.562160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ebad3-e9e9-4250-90c6-61c6e871a3c1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:11.594602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:11.595208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:11.595488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:11.595760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] PATH_INFO: `/v3/users/ec092960524f40cf858bc27c86649d48` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:11.596856 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ec092960524f40cf858bc27c86649d48)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:11.598304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:11.599913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 565/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:04:11 2022] GET /identity/v3/users/ec092960524f40cf858bc27c86649d48 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:11.606211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:11.696505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:11.705187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627766dc-6527-4ca7-9d60-b670415859fe None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:11.738373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae06a6b-5f25-481d-850b-2ba9e848af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:11.739120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae06a6b-5f25-481d-850b-2ba9e848af17 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:11.739403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae06a6b-5f25-481d-850b-2ba9e848af17 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:11.739677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae06a6b-5f25-481d-850b-2ba9e848af17 None admin] PATH_INFO: `/v3/projects/0b4659ec259e4e28b55e39a80fdfb178` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:11.740850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae06a6b-5f25-481d-850b-2ba9e848af17 None admin] RBAC: Authorizing `identity:get_project(project_id=0b4659ec259e4e28b55e39a80fdfb178)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:11.742297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae06a6b-5f25-481d-850b-2ba9e848af17 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:11.743920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 587/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:11 2022] GET /identity/v3/projects/0b4659ec259e4e28b55e39a80fdfb178 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:11.749851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:11.765739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:11.847764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760114b-4b43-4929-b1b1-44c65e7ea7c3 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:11.880062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e8355-692e-409c-9b48-9c8fa05baf62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:11.880706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e8355-692e-409c-9b48-9c8fa05baf62 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:11.880989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e8355-692e-409c-9b48-9c8fa05baf62 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:11.881910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e8355-692e-409c-9b48-9c8fa05baf62 None admin] PATH_INFO: `/v3/projects/0b4659ec259e4e28b55e39a80fdfb178/users/ec092960524f40cf858bc27c86649d48/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:11.883895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e8355-692e-409c-9b48-9c8fa05baf62 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b4659ec259e4e28b55e39a80fdfb178, user_id=ec092960524f40cf858bc27c86649d48, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:11.885321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e8355-692e-409c-9b48-9c8fa05baf62 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:11.899404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 566/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:04:11 2022] PUT /identity/v3/projects/0b4659ec259e4e28b55e39a80fdfb178/users/ec092960524f40cf858bc27c86649d48/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:04:13.752716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993abd-e3eb-4a94-ad10-c6c01e7f7c1b None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:13.753292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993abd-e3eb-4a94-ad10-c6c01e7f7c1b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:13.753292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc993abd-e3eb-4a94-ad10-c6c01e7f7c1b None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:13.754639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 588/1154] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:13.760487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:13.760890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:13.761040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:13.779251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:13.780431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:13.845177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 567/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:14.111919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc993abd-e3eb-4a94-ad10-c6c01e7f7c1b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:14.219778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc993abd-e3eb-4a94-ad10-c6c01e7f7c1b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:14.257694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:14.258456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:14.258770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:14.259070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:14.269790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:04:14.275114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:14.276226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:04:14.277098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 589/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:14.282249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:14.285288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:14.378994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17080cce-68b7-4e68-8132-cad5c9b85d83 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:14.411499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:14.412124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:14.413068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:14.413350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:14.414042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:14.414348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:14.417750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:14.425548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 568/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:14.431532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:14.453321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:14.530277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8d77ef-cbb7-4436-89cd-b5e449a17696 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:14.562994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:14.563617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:14.563903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:14.564178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] PATH_INFO: `/v3/users/ec092960524f40cf858bc27c86649d48` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:14.565294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ec092960524f40cf858bc27c86649d48)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:14.566739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:14.568309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 590/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:04:14 2022] GET /identity/v3/users/ec092960524f40cf858bc27c86649d48 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:14.574440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:14.638201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:14.672962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c612e-e235-4a24-8ea6-689271183c7c None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:14.704575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:14.705168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:14.705447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:14.705739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:14.771580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:14.773668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:14.833286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:14.868303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 569/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:04:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:14.874385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:14.961487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:14.973426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a8b1d9-60a1-4e91-af13-5a422664b1b1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:15.005317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72a828-39d8-4844-90b8-83b58d1550c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:15.005954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a828-39d8-4844-90b8-83b58d1550c2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:15.007032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a828-39d8-4844-90b8-83b58d1550c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:15.007488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72a828-39d8-4844-90b8-83b58d1550c2 None admin] PATH_INFO: `/v3/projects/0b4659ec259e4e28b55e39a80fdfb178` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:15.008421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a828-39d8-4844-90b8-83b58d1550c2 None admin] RBAC: Authorizing `identity:get_project(project_id=0b4659ec259e4e28b55e39a80fdfb178)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:15.009864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72a828-39d8-4844-90b8-83b58d1550c2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:15.011487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 591/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:14 2022] GET /identity/v3/projects/0b4659ec259e4e28b55e39a80fdfb178 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:15.017604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:15.114014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471e9a0-483d-4f48-b7e8-28f89fd57ec1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:15.147603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:15.148189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:15.148469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:15.148742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:15.149463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=0b4659ec259e4e28b55e39a80fdfb178, user.id=ec092960524f40cf858bc27c86649d48) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:15.149801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:15.151224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7d3fbe-4154-459a-b47e-5bd5b4a9ebf6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:15.156754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 570/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:04:15 2022] GET /identity/v3/role_assignments?user.id=ec092960524f40cf858bc27c86649d48&scope.project.id=0b4659ec259e4e28b55e39a80fdfb178&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:17.052217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4d82-9756-4309-88d9-e1780fdc9eee None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:17.052730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4d82-9756-4309-88d9-e1780fdc9eee None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:17.052854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2d4d82-9756-4309-88d9-e1780fdc9eee None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:17.054751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 592/1162] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:17.059803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:17.060231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:17.060364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:17.078267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:17.079461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:17.102940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:17.146750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 571/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:17.418990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4d82-9756-4309-88d9-e1780fdc9eee None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:17.519340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2d4d82-9756-4309-88d9-e1780fdc9eee None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:17.551331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:17.551923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:17.552206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:17.552478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:17.577252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:17.619478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:17.620916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:17.717729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 593/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:04:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:17.723517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:17.820635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ef081-0551-47bb-ab41-9f7ee721c6d3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:17.853596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:17.854415 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:17.854699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:17.854976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:17.861461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:17.862952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7e155ba7-e129-4e43-af78-1116252fdbb8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:17.874737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:17.875897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:04:17.876907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 572/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:04:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:17.882075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:17.937763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:17.981232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75f162-495c-4f45-a027-69503d201dce None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:18.014610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:18.015211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:18.015492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:18.015761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:18.016393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:18.016694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:18.018059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0804b-b655-4e13-9dca-0518afae0be8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:18.025222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 594/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Aug 30 00:04:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:19.918971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027196-6e5f-4d92-891e-698e3ef6a767 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:19.919406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027196-6e5f-4d92-891e-698e3ef6a767 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:19.919530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab027196-6e5f-4d92-891e-698e3ef6a767 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:19.920896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 573/1167] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:19.926011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538ef4-9b40-4ef5-bbca-e781832cefeb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:19.926421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538ef4-9b40-4ef5-bbca-e781832cefeb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:19.926562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87538ef4-9b40-4ef5-bbca-e781832cefeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:19.945796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-87538ef4-9b40-4ef5-bbca-e781832cefeb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:19.946975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-87538ef4-9b40-4ef5-bbca-e781832cefeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:20.013070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 595/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:20.287866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027196-6e5f-4d92-891e-698e3ef6a767 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:20.309770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:20.388401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab027196-6e5f-4d92-891e-698e3ef6a767 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:20.421271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbccd7c-55d4-4e34-a7a0-75874a87b690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:20.421895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbccd7c-55d4-4e34-a7a0-75874a87b690 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:20.422175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbccd7c-55d4-4e34-a7a0-75874a87b690 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:20.422443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbccd7c-55d4-4e34-a7a0-75874a87b690 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:20.423097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbccd7c-55d4-4e34-a7a0-75874a87b690 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:20.424444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbccd7c-55d4-4e34-a7a0-75874a87b690 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:20.440743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 574/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Aug 30 00:04:20 2022] POST /identity/v3/domains => generated 267 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:04:22.358894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edfc85-9eb4-4423-91e9-d46c46522d0d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:22.359398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edfc85-9eb4-4423-91e9-d46c46522d0d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:22.359398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edfc85-9eb4-4423-91e9-d46c46522d0d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:22.360711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 596/1170] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:22.366366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:22.366805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:22.366896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:22.384859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:22.386055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:22.450713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 575/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:22.720605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edfc85-9eb4-4423-91e9-d46c46522d0d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:22.771374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:22.822100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edfc85-9eb4-4423-91e9-d46c46522d0d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:22.856800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f7c64a-438f-4a00-849e-3a52c4ef0740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:22.857496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c64a-438f-4a00-849e-3a52c4ef0740 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:22.857807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c64a-438f-4a00-849e-3a52c4ef0740 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:22.858083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c64a-438f-4a00-849e-3a52c4ef0740 None admin] PATH_INFO: `/v3/domains/6fb31da325dd4d83a3cf7c5ece0dbd20` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:22.868267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7c64a-438f-4a00-849e-3a52c4ef0740 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6fb31da325dd4d83a3cf7c5ece0dbd20)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:22.869689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f7c64a-438f-4a00-849e-3a52c4ef0740 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:22.871485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 597/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Aug 30 00:04:22 2022] GET /identity/v3/domains/6fb31da325dd4d83a3cf7c5ece0dbd20 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:22.877049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:22.889398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:22.976493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ca8ef-e0e8-46a6-b85e-b3ae977be1fa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:23.008853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5a6d5-f33f-44f6-b2b1-51cafcf53f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:23.009439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a6d5-f33f-44f6-b2b1-51cafcf53f18 None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:23.009744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a6d5-f33f-44f6-b2b1-51cafcf53f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:23.010014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5a6d5-f33f-44f6-b2b1-51cafcf53f18 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:23.010659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a6d5-f33f-44f6-b2b1-51cafcf53f18 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:23.012074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba5a6d5-f33f-44f6-b2b1-51cafcf53f18 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:23.037328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 576/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:04:22 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:04:24.947621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560aa4-8cec-4209-b152-72d685c2fdee None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:24.948143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560aa4-8cec-4209-b152-72d685c2fdee None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:24.948241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22560aa4-8cec-4209-b152-72d685c2fdee None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:24.949561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 598/1174] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:24.954747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:24.955166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:24.955297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:24.973905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:24.975753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:25.030419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:25.042150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 577/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:25.310773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560aa4-8cec-4209-b152-72d685c2fdee None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:25.411709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22560aa4-8cec-4209-b152-72d685c2fdee None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:25.421619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:25.445594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d503266-936b-41cd-b831-54829f6d9ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:25.446245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d503266-936b-41cd-b831-54829f6d9ebf None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:25.446530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d503266-936b-41cd-b831-54829f6d9ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:25.446817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d503266-936b-41cd-b831-54829f6d9ebf None admin] PATH_INFO: `/v3/domains/6fb31da325dd4d83a3cf7c5ece0dbd20` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:25.447928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d503266-936b-41cd-b831-54829f6d9ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=6fb31da325dd4d83a3cf7c5ece0dbd20)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:25.449356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d503266-936b-41cd-b831-54829f6d9ebf None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:25.450974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 599/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Aug 30 00:04:25 2022] GET /identity/v3/domains/6fb31da325dd4d83a3cf7c5ece0dbd20 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:25.456669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:25.553333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7d8cd-7910-4ecf-860a-3e68ed9728f6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:25.587251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da1ae5-d429-488d-97cb-bcfcf001137d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:25.587789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da1ae5-d429-488d-97cb-bcfcf001137d None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:25.588072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da1ae5-d429-488d-97cb-bcfcf001137d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:25.588347 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da1ae5-d429-488d-97cb-bcfcf001137d None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:25.589005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da1ae5-d429-488d-97cb-bcfcf001137d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:25.590460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da1ae5-d429-488d-97cb-bcfcf001137d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:25.611035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 578/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:04:25 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:04:27.552909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa6f9-2aec-4a3e-9362-e2a43187b00d None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:27.553607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa6f9-2aec-4a3e-9362-e2a43187b00d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:27.553607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478aa6f9-2aec-4a3e-9362-e2a43187b00d None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:27.555070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 600/1178] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:27.560963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:27.561377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:27.561510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:27.579312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:27.580482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:27.622884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:27.645829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 579/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:04:27.914490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa6f9-2aec-4a3e-9362-e2a43187b00d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:28.013818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478aa6f9-2aec-4a3e-9362-e2a43187b00d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:28.046686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:28.047296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:28.047575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:28.047845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:28.058224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:04:28.062894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:28.063897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:04:28.064936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 601/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:04:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:28.070395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:28.167853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb223e3d-8fb6-4f46-93e4-4d3ab4a963d1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:28.199986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:28.200582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:28.200865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:28.201139 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:28.201828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:28.202134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:28.203497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:28.211841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 580/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:04:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:04:28.217543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:28.259102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:28.317209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc70c1-f14a-46eb-ba06-738f982a5517 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:28.350875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:28.351481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:28.351759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:28.352026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] PATH_INFO: `/v3/users/88e238a23d6f47bda6ee3ea160869906` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:28.364817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] RBAC: Authorizing `identity:get_user(user_id=88e238a23d6f47bda6ee3ea160869906)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:28.366615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:28.368208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 602/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:04:28 2022] GET /identity/v3/users/88e238a23d6f47bda6ee3ea160869906 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:28.374106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:28.415744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:28.472234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e132ba-1bc7-4c9e-80da-fc86ae31f4e6 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:28.505419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:28.506037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:28.506833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:28.507365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:28.573336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:28.574812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:28.613745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:28.672054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 581/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:04:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:28.678738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:28.773397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:28.779431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30597f-5f6e-494c-9130-bd82cb469692 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:28.812997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00926dd-f70e-47c8-b0df-90320c42b15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:28.813754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00926dd-f70e-47c8-b0df-90320c42b15c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:28.813962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00926dd-f70e-47c8-b0df-90320c42b15c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:28.814237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00926dd-f70e-47c8-b0df-90320c42b15c None admin] PATH_INFO: `/v3/projects/9583deac7f854bfabaa5c1a114f474ba` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:28.815349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00926dd-f70e-47c8-b0df-90320c42b15c None admin] RBAC: Authorizing `identity:get_project(project_id=9583deac7f854bfabaa5c1a114f474ba)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:28.816768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00926dd-f70e-47c8-b0df-90320c42b15c None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:28.818445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 603/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:28 2022] GET /identity/v3/projects/9583deac7f854bfabaa5c1a114f474ba => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:28.825577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:28.937028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448bf5da-3082-43e3-b091-d91c8f82b859 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:28.974310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:28.974310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:28.974659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:28.974812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:28.976625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=9583deac7f854bfabaa5c1a114f474ba, user.id=88e238a23d6f47bda6ee3ea160869906) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:28.976932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:28.978864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7554db04-98d4-400f-9f29-60c91596453b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:28.984464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 582/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:04:28 2022] GET /identity/v3/role_assignments?user.id=88e238a23d6f47bda6ee3ea160869906&scope.project.id=9583deac7f854bfabaa5c1a114f474ba&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:30.877161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a6b8-1a03-4887-8bed-da547a21088e None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:30.877745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a6b8-1a03-4887-8bed-da547a21088e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:30.877745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e700a6b8-1a03-4887-8bed-da547a21088e None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:30.879064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 604/1186] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:30.885309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:30.885725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:30.885902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:30.893062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:30.904188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:30.905376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:30.971754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 583/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:31.245732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700a6b8-1a03-4887-8bed-da547a21088e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:31.347927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e700a6b8-1a03-4887-8bed-da547a21088e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:31.381613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:31.382515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:31.382800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:31.383077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:31.392902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:04:31.397735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:31.398837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:04:31.399813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 605/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:31.404859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:31.500298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6ee4a-e450-48fe-8621-6d561414c5fe None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:31.532246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:31.532835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:31.533113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:31.533384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:31.534068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:31.534367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:31.535723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:31.537031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:31.544650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 584/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:31.550426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:31.576264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:31.650442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a983e8b-b155-4194-bda7-5fffbc51a199 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:31.683704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:31.684320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:31.684605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:31.684885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] PATH_INFO: `/v3/users/88e238a23d6f47bda6ee3ea160869906` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:31.686039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] RBAC: Authorizing `identity:get_user(user_id=88e238a23d6f47bda6ee3ea160869906)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:31.687464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:31.689037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 606/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:04:31 2022] GET /identity/v3/users/88e238a23d6f47bda6ee3ea160869906 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:31.694831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:31.791056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b34df-12e9-4d6c-bc9e-541c77fe5662 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:31.822581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f367ecb-ecc8-46a1-835a-77b471fcc2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:31.823193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f367ecb-ecc8-46a1-835a-77b471fcc2ee None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:31.823471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f367ecb-ecc8-46a1-835a-77b471fcc2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:31.823740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f367ecb-ecc8-46a1-835a-77b471fcc2ee None admin] PATH_INFO: `/v3/projects/9583deac7f854bfabaa5c1a114f474ba` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:31.824831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f367ecb-ecc8-46a1-835a-77b471fcc2ee None admin] RBAC: Authorizing `identity:get_project(project_id=9583deac7f854bfabaa5c1a114f474ba)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:31.826276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f367ecb-ecc8-46a1-835a-77b471fcc2ee None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:31.827865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 585/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:31 2022] GET /identity/v3/projects/9583deac7f854bfabaa5c1a114f474ba => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:31.833772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:31.923718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:31.932927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c5e983-f963-40d4-8dec-e36e81da4cb1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:31.966126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b47c160-ed53-4a6f-9837-56106f8ee792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:31.966777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c160-ed53-4a6f-9837-56106f8ee792 None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:31.967058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c160-ed53-4a6f-9837-56106f8ee792 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:31.967331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b47c160-ed53-4a6f-9837-56106f8ee792 None admin] PATH_INFO: `/v3/projects/9583deac7f854bfabaa5c1a114f474ba/users/88e238a23d6f47bda6ee3ea160869906/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:31.969202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47c160-ed53-4a6f-9837-56106f8ee792 None admin] RBAC: Authorizing `identity:create_grant(project_id=9583deac7f854bfabaa5c1a114f474ba, user_id=88e238a23d6f47bda6ee3ea160869906, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:31.970652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b47c160-ed53-4a6f-9837-56106f8ee792 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:31.983342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 607/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:04:31 2022] PUT /identity/v3/projects/9583deac7f854bfabaa5c1a114f474ba/users/88e238a23d6f47bda6ee3ea160869906/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:04:33.886557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eef92-9f10-42ea-893c-3831b814f2bf None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:33.887086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eef92-9f10-42ea-893c-3831b814f2bf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:33.887086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955eef92-9f10-42ea-893c-3831b814f2bf None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:33.888442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 586/1193] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:04:33.893434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:33.893847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:33.894013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:33.913789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:04:33.914988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:04:33.980621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 608/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:04:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:04:34.250603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eef92-9f10-42ea-893c-3831b814f2bf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:34.313068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:34.352158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955eef92-9f10-42ea-893c-3831b814f2bf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:34.384960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:34.385571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:34.385881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:34.386154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:34.396335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:04:34.401656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:04:34.402757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:04:34.403686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 587/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:04:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:04:34.408840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:34.489996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:34.509442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47283142-af0d-4344-9148-8b4c6240cdc5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:34.543715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:34.544310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:34.544596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:34.544873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:34.545535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:34.545881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:34.547228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:34.555166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 609/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:04:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:34.560955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:34.659230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b3aaa-44f0-4791-9535-f7adfdfc9343 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:34.682018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:34.693076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:34.694321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:34.694870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:34.694870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] PATH_INFO: `/v3/users/88e238a23d6f47bda6ee3ea160869906` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:34.695922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] RBAC: Authorizing `identity:get_user(user_id=88e238a23d6f47bda6ee3ea160869906)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:34.697346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:34.698953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 588/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Aug 30 00:04:34 2022] GET /identity/v3/users/88e238a23d6f47bda6ee3ea160869906 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:34.704773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:34.801636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234829-2a48-4685-9fe3-fc7e799d50ea None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:34.835064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:34.835652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:34.835936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:34.836214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:34.850037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:34.902117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:34.903553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:35.001157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 610/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:04:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:04:35.007515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:35.104522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bc099-7e6e-41d4-a5f4-fbee807835bf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:35.136604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7813223-4145-4af4-b7e0-1bb3e5f95f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:35.137211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7813223-4145-4af4-b7e0-1bb3e5f95f95 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:35.137489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7813223-4145-4af4-b7e0-1bb3e5f95f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:35.137793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7813223-4145-4af4-b7e0-1bb3e5f95f95 None admin] PATH_INFO: `/v3/projects/9583deac7f854bfabaa5c1a114f474ba` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:35.138890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7813223-4145-4af4-b7e0-1bb3e5f95f95 None admin] RBAC: Authorizing `identity:get_project(project_id=9583deac7f854bfabaa5c1a114f474ba)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:35.140296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7813223-4145-4af4-b7e0-1bb3e5f95f95 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:35.141919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 589/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Aug 30 00:04:35 2022] GET /identity/v3/projects/9583deac7f854bfabaa5c1a114f474ba => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:04:35.148533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:04:35.193214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:35.246709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2bce23-fd26-4222-8598-50b4fa145dc3 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:04:35.280481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:04:35.281079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:04:35.281362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:04:35.281635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:04:35.282381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=9583deac7f854bfabaa5c1a114f474ba, user.id=88e238a23d6f47bda6ee3ea160869906) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:04:35.282696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:04:35.284101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae78a0-7c3a-4912-bea7-17645308a2b7 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:04:35.290412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 611/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:04:35 2022] GET /identity/v3/role_assignments?user.id=88e238a23d6f47bda6ee3ea160869906&scope.project.id=9583deac7f854bfabaa5c1a114f474ba&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:04:45.132353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=70 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:04:45.287250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=46 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:31.923327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615af5-8ac0-4e4a-aa8d-7a00644894d1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:31.923930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615af5-8ac0-4e4a-aa8d-7a00644894d1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:31.923930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d615af5-8ac0-4e4a-aa8d-7a00644894d1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:31.925485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 590/1201] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:05:31.931318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:31.936068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:31.936068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:31.965216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:31.966730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:32.061903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 612/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:05:32.381907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615af5-8ac0-4e4a-aa8d-7a00644894d1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:32.530776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d615af5-8ac0-4e4a-aa8d-7a00644894d1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:32.583080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:32.583947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:32.584228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:32.584494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:32.604108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:32.605809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:32.624298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:32.625418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:32.626502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:32.626502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:32.626502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:32.626502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 591/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:05:32.632703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:32.778987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b264eaad-4e66-4e1a-ab99-27868c9935af None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:32.824515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:32.832229 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:32.832756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:32.833035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:32.834289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:32.834289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:32.834289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:32.836483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502ae8ac-d051-4743-a0ad-db4b2c31726a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:32.849344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 613/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:32.855474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:32.949522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:33.016401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde5ec8-e55a-4955-bef3-7c1d6c9642f9 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:33.066144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea91d2d9-11ca-4c99-aefa-90577e082e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:33.066730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d2d9-11ca-4c99-aefa-90577e082e2f None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:33.067012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d2d9-11ca-4c99-aefa-90577e082e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:33.067295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea91d2d9-11ca-4c99-aefa-90577e082e2f None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:33.067941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d2d9-11ca-4c99-aefa-90577e082e2f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:33.069405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea91d2d9-11ca-4c99-aefa-90577e082e2f None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:33.109737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 592/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Aug 30 00:05:32 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:05:35.467524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2b72-03be-491e-8ece-d5c93016c735 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:35.468105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2b72-03be-491e-8ece-d5c93016c735 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:35.468105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa2b72-03be-491e-8ece-d5c93016c735 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:35.469593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 614/1206] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:05:35.474867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:35.475289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:35.475438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:35.495779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:35.496995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:35.583562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 593/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:05:35.879441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2b72-03be-491e-8ece-d5c93016c735 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:36.031777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa2b72-03be-491e-8ece-d5c93016c735 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:36.080121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:36.080881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:36.081155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:36.081506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:36.101154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:05:36.106994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:36.109868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:36.111487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 615/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:36.117021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:36.162295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:36.240869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bc71ad-9c60-41cb-9687-4d327c07f46b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:36.288432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:36.289186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:36.290801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:36.290801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:36.291188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:36.291335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:36.292787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:36.304774 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 594/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:05:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:36.312551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:36.391194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:36.468445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9397502-93a0-4990-97cd-6ca48307d80c None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:36.510052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:36.510883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:36.511217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:36.511431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:36.523262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:36.525346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:36.542386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:36.543593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:36.544571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:36.544571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:36.544571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:36.545999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 616/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:36.552189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:36.675393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:36.678466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9921feec-ede8-4da1-8854-d6a48daa3d91 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:36.718772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:36.719459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:36.719745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:36.720018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:36.720666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:36.721008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:36.722423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:36.741887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 595/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:36.743026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:36.864149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd1cc2-e17e-4cb6-8406-9a0bab7d1814 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:36.865872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:36.919125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:36.919774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:36.920059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:36.920332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:36.928659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:36.930385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:05:36.950379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:36.951834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:36.953429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 617/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:36.958766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:37.079092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617692e-3bbb-4bb8-944f-ee319b13c9e1 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:37.119087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:37.119509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:37.119794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:37.120068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:37.120812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:37.121185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:37.122597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:37.146462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 596/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 00:05:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:37.148170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:37.280485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36227-fb70-4e2b-8d59-0b921b0059cd None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:37.328506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:37.329201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:37.329431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:37.329713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:37.370098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:37.426339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:37.427937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:37.565314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 618/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:05:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:05:37.566540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:37.590545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:37.695246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ff445-fd86-4c6f-aebd-c0e591ebd588 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:37.738043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:37.739279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:37.739279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:37.739635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:37.752738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:37.754444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:37.771291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:37.772506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:37.773604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:37.773604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:37.773604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:37.775796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 597/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:37.781821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:37.852693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:37.896737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc02ae7-c55d-4452-86a8-0977f000c1ab None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:37.950192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:37.950920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:37.951207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:37.951491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:37.952148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:37.952453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:37.954012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:37.968528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 619/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:37.974871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:38.062320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:38.097597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58b703-f2f4-499f-a24c-391a486a8780 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:38.136743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:38.137388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:38.137671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:38.137977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:38.144979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:38.146470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:05:38.157904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:38.158879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:38.163167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 598/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:38.165390 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:38.301234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cbe07-a1ee-4dfe-b17e-0c0d9ac254b2 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:38.329141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:38.344981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:38.345788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:38.346250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:38.346614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:38.347609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:38.348009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:38.350028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2551787-e0c1-4e32-a456-465b2f4c868f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:38.369675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 620/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:38.375882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:38.507535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760dd929-abb5-4c63-9d58-700c0f25a9f8 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:38.561755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:38.573239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:38.574452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:38.574931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:38.575426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:38.576732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=b0af289f07d14247a60083dcc34197a1) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:38.577244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:38.579850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50bb69-57ee-4a2a-873d-8e9787fe05b9 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:38.597804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 599/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:05:38 2022] GET /identity/v3/role_assignments?user.id=b0af289f07d14247a60083dcc34197a1&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:40.609936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b1458-68f7-4aaa-b71a-868dbb696b96 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:40.610525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b1458-68f7-4aaa-b71a-868dbb696b96 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:40.610525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b1458-68f7-4aaa-b71a-868dbb696b96 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:40.611911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 621/1220] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:05:40.617644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:40.618252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:40.618359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:40.639214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:40.640412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:40.721660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 600/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:05:40.994108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b1458-68f7-4aaa-b71a-868dbb696b96 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:41.136842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b1458-68f7-4aaa-b71a-868dbb696b96 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:41.181317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:41.181988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:41.182290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:41.182622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:41.199192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:05:41.205084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:41.206064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:41.206919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 622/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:05:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:05:41.213387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:41.326324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae58e741-fa57-4cf0-8d6d-ebb6c3679ad4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:41.358869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:41.373150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:41.373894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:41.374219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:41.374522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:41.375332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:41.375642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:41.377173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:41.388825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 601/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:05:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:41.395484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:41.449951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:41.530441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79608bcc-1be3-42c1-b4f3-7ad6ccf3fef1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:41.565151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:41.565810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:41.566092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:41.566364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:41.579239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:41.580681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:41.597006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:41.598264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:41.599276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:41.599276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:41.599276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:41.599276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 623/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:41.604345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:41.715331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77565cc6-5183-41d2-8588-aa0baa9e8b01 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:41.758075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:41.759572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:41.760024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:41.760300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:41.761201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:41.761507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:41.762900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:41.775677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 602/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:41.781908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:41.892886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:41.901315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff506c-e289-431f-8061-b15269971c3e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:41.940811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:41.941494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:41.941851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:41.942178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:41.951007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:41.952487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:05:41.965664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:41.966742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:41.967672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 624/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:41.972927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:42.029152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:42.091597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b41b8-cd3b-4e73-8808-dfcb97826896 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:42.141128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:42.141764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:42.142063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:42.142327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:42.143075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:42.143389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:42.144800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:42.164164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 603/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 00:05:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:42.170447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:42.311175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666945c3-ae9f-45f6-b399-acdaf0af79c1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:42.352643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:42.353396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:42.353699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:42.354111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:42.365472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:42.367044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:42.384809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:42.386268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:42.387149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:42.387149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:42.387149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:42.387149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 625/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:05:42.392678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:42.530724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be50cf6-4f65-4e01-9d5a-7e75c9168dbc None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:42.533860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:42.570231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:42.570701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:42.570979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:42.571255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:42.572020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:42.572328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:42.573734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:42.589958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 604/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:42.596224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:42.606521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:42.729892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5423bf2-ccab-4e1e-8687-5dd20e49caea None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:42.771456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:42.772531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:42.772909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:42.773200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:42.781546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:42.783026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:05:42.800552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:42.802310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:42.803506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 626/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:05:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:42.809621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:42.928459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae50ac-972b-45a1-960c-9b060ecba9cf None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:42.969924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:42.970831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:42.971165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:42.971459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:42.972366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:42.972758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:42.974342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d8c2-54b7-4c84-9e05-c33d0bb3622a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:42.990420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 605/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:05:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:42.997646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:43.079203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:43.121595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b27367-0db8-4982-bc94-4db2c4479c60 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:43.161128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9f992-59b9-4a30-a78e-045d81d9256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:43.161818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9f992-59b9-4a30-a78e-045d81d9256a None admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:43.162105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9f992-59b9-4a30-a78e-045d81d9256a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:43.162380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9f992-59b9-4a30-a78e-045d81d9256a None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/b0af289f07d14247a60083dcc34197a1/roles/6b50fc5c74014a51b6dbc8595badbf1c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:43.179710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9f992-59b9-4a30-a78e-045d81d9256a None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=b0af289f07d14247a60083dcc34197a1, role_id=6b50fc5c74014a51b6dbc8595badbf1c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:43.181847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9f992-59b9-4a30-a78e-045d81d9256a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:43.195373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 627/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:05:42 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/b0af289f07d14247a60083dcc34197a1/roles/6b50fc5c74014a51b6dbc8595badbf1c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:05:45.189642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1c10-7a97-49ca-9ccd-77266628efa6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:45.190264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1c10-7a97-49ca-9ccd-77266628efa6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:45.190264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c1c10-7a97-49ca-9ccd-77266628efa6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:45.191462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 606/1233] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:05:45.198479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:45.198959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:45.199149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:45.218300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:45.219515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:45.311307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 628/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:05:45.608633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c1c10-7a97-49ca-9ccd-77266628efa6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:45.637201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:45.747729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c1c10-7a97-49ca-9ccd-77266628efa6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:45.794061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:45.795099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:45.795578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:45.796053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:45.809413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:05:45.814279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:45.817789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:45.818810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 607/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Aug 30 00:05:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:45.822528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:45.877113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:45.941668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f060a0-6b86-4930-b245-38ef1e5eca30 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:45.983681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:45.984445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:45.984961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:45.985117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:45.985887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] RBAC: Adding query filter params (name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:45.986588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:45.987743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:45.997633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 629/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Aug 30 00:05:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:46.003764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:46.107142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:46.125900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6ae890-45c9-4fec-9769-bcf0abd86c14 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:46.170195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:46.170804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:46.171190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:46.171468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:46.184367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:46.186106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:46.204275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:46.205978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:46.207050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:46.207050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:46.207050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:46.207050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 608/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:46.212356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:46.335652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8005f525-315f-4d76-ab91-d980bf1bab82 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:46.349602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:46.378394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:46.379398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:46.379921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:46.380397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:46.381538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:46.382157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:46.385200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:46.404072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 630/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:46.409816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:46.534357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08144677-b847-40c1-8361-363f45fd7d20 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:46.575557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:46.578032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:46.578354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:46.578636 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:46.581500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:46.589268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:46.590820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:05:46.604365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:46.605806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:46.607392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 609/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:46.612933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:46.729866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678094-d11d-46dd-a4e3-ce2acf250a7e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:46.769419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:46.770079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:46.770364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:46.770642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:46.771392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:46.771702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:46.773143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:46.806960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 631/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 00:05:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:46.808293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:46.935834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f74ac7-3655-4b54-aca7-f8ec7c6cbb6d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:46.979501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:46.980280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:46.980570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:46.980843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:47.054245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:47.063110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:47.064728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:47.175567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 610/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:05:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:05:47.181961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:47.209496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:47.299246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea2fce-0e7b-4aa6-a8d7-f2ca0eaa5b7d None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:47.342249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:47.342804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:47.343084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:47.343354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:47.355740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:47.357224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:47.381298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:47.382543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:47.384401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:47.384401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:47.384401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:47.384401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 632/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 30 00:05:47.389222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:47.515062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:47.522119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1895cc-6deb-4993-b1bd-a3fe3e9dfdd2 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:47.566341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:47.567096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:47.567548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:47.567861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:47.568865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:47.569072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:47.570761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:47.586345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 611/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:47.594313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:47.698567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:47.726006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130f6f3-333d-4988-9b0a-6beaf6854a0f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:47.766290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:47.766924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:47.767210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:47.767487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:47.774554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:47.776001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:05:47.792777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:47.794136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:47.795135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:47.799211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 633/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:47.800403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:47.924021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab00842-c963-4731-84b9-7a3739e65cba None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:47.974617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:47.975231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:47.975510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:47.975782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:47.976487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:47.976795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:47.979219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25982d54-149e-4a65-bfdb-5400bd640e9d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:47.991451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 612/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:47.998147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:48.122054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77555b7e-04d5-4a59-b51e-26828ff7fa1a None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:48.165531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:48.166223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:48.166505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:48.166781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:48.167734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] RBAC: Adding query filter params (role.id=6b50fc5c74014a51b6dbc8595badbf1c, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=b0af289f07d14247a60083dcc34197a1) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:48.167977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:48.169551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bbcac-44c0-48a7-97fe-9132eb2fe4dd None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:48.176323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 634/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:05:47 2022] GET /identity/v3/role_assignments?user.id=b0af289f07d14247a60083dcc34197a1&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=6b50fc5c74014a51b6dbc8595badbf1c => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:50.330697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c19a2-cdce-48c3-b2ce-057abf45d0c1 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:50.331557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c19a2-cdce-48c3-b2ce-057abf45d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:50.331557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c19a2-cdce-48c3-b2ce-057abf45d0c1 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:50.333480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 613/1247] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:05:50.340197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:50.341021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:50.341177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:50.349056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:50.369945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:50.371321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:50.450347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 635/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:05:50.765957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c19a2-cdce-48c3-b2ce-057abf45d0c1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:50.788273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:50.918265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c19a2-cdce-48c3-b2ce-057abf45d0c1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:50.965981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:50.966629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:50.966913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:50.967284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:50.983667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:05:50.989800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:50.991414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:50.992273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 614/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:50.997847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:51.133217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8887daf-4a0b-4bd7-a701-e5a8795186f1 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:51.188970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:51.195645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:51.196313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:51.196591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:51.196865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:51.197579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:51.197919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:51.199308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:51.208092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 636/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:05:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:51.214392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:51.313923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:51.343692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cec21a-936e-4bb1-a570-4017d564b20d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:51.387800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:51.388353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:51.388631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:51.388899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:51.400225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:51.401779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:51.418222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:51.419699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:51.420945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:51.420945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:51.420945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:51.420945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 615/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:51.425641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:51.554641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442db899-c172-4227-b1cc-baab5be549c1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:51.594720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:51.595338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:51.595622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:51.595897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:51.596541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:51.596871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:51.598487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:51.613659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 637/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:51.619579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:51.733638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28c148-e8e0-47af-83fa-447926d21100 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:51.766350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:51.777656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:51.778874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:51.779456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:51.781204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:51.790949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:51.792491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:05:51.808571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:51.809780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:51.811150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 616/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:51.817337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:51.905464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:51.987149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b669e34-4c67-4658-8a5e-7e0254f524e8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:52.038292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:52.039136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:52.039608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:52.040600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:52.041938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:52.042567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:52.045267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:52.078427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 638/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 00:05:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:52.084227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:52.229128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd93b6-5486-48b5-b9dd-db4424e48986 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:52.283811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:52.284285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:52.284587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:52.284839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:52.373140 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:52.390528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:52.392362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:52.507940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 617/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:05:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:05:52.515051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:52.632680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aee11f-4532-4b8b-be2d-9f5c1f1bca01 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:52.650402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:52.675084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:52.675724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:52.676009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:52.676284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:52.689278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:52.691019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:52.708401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:52.710018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:52.711771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:52.711771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:52.711771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:52.711771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 639/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:52.716143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:52.830088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:52.845282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09583eb1-f034-41a4-bee4-14a7c5d4b240 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:52.888254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:52.888837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:52.889160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:52.889650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:52.890422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:52.890845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:52.892223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:52.917773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 618/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:52.919544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:53.041681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df73f61-4ddd-4eef-814d-555b48b27e06 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:53.091371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:53.092021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:53.092449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:53.092753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:53.100798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:53.102406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:05:53.118543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:53.119998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:05:53.120906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 640/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:05:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:53.126649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:53.257406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d6edcf-5f1a-4897-881a-1c3e11077677 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:53.306259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:53.307720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:53.308049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:53.308446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:53.309329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:53.309784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:53.311701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec551397-670b-48d7-ad8f-b03b2cb66266 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:53.329301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 619/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:05:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:53.335475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:53.365914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:53.464660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc37eb-6dac-483d-bd04-3a63a1e380de None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:53.499266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:53.499858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:53.500138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:53.500409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:53.501139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=b0af289f07d14247a60083dcc34197a1) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:53.501447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:53.502893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb4dd62-561f-4a00-8089-85b1c789e3a8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:53.508436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 641/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:05:53 2022] GET /identity/v3/role_assignments?user.id=b0af289f07d14247a60083dcc34197a1&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=46ba8574dccb497790ae947ec68f522d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:55.501335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd9b1f-ed46-4b9f-8003-3d698a1aa726 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:55.501928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd9b1f-ed46-4b9f-8003-3d698a1aa726 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:55.502021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd9b1f-ed46-4b9f-8003-3d698a1aa726 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:55.503484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 620/1261] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:05:55.508581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:55.509044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:55.509234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:55.528631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:55.529874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:55.598273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 642/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:05:55.872861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd9b1f-ed46-4b9f-8003-3d698a1aa726 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:55.885391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:55.982961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd9b1f-ed46-4b9f-8003-3d698a1aa726 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:56.018271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:56.018903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:56.019188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:56.019467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:56.029936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:05:56.034715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:56.035894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:56.036918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 621/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:05:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:56.042010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:56.060588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:56.140742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd30f5-c586-4162-b545-f41633b575c8 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:56.173835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:56.174431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:56.174709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:56.174978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:56.175635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:56.175935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:56.177272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:56.186088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 643/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:56.193615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:56.262512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:56.299355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be6e87-feac-4f3d-b988-21a6f0a28822 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:56.340208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:56.341026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:56.341405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:56.341815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:56.354920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:56.356367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:56.370779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:56.375710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:56.376848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:56.376848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:56.376848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:56.376848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 622/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:56.377921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:56.457407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:56.476514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bd488-ea3c-4f28-b86c-93d4fed71914 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:56.510185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:56.510813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:56.511080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:56.511352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:56.512248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:56.512552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:56.513922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:56.525508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 644/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:56.531344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:56.630013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c918054-3668-4561-8f8e-027f63a8f8aa None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:56.658962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:56.670689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:56.671315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:56.671591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:56.671857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:56.679705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:56.682346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:05:56.693960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:56.695715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:56.697641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 623/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:56.702718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:56.803640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a764430-81d7-46f1-85bf-230e55c0caa1 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:56.839358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:56.839964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:56.840252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:56.840573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:56.841309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:56.841610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:56.843062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:56.852058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:56.862636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 645/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 00:05:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:56.868729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:56.970765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d904affc-1002-4c55-863f-e3f796610569 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:57.010622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:57.011389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:57.011733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:57.012325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:57.023007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:57.025698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:05:57.039431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:57.041111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:05:57.042228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:05:57.042228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:05:57.042228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:57.042228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 624/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:57.047180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:57.145909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2841a1a-43f9-4360-b962-b1f4a9c79a30 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:57.180173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:57.180813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:57.181096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:57.181451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:57.182132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:57.182440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:57.183810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:57.195085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 646/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:05:57.202297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:57.233510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:57.302646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87a4fe-6cb1-4cd1-8766-87a63979c90a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:57.335741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:57.336368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:57.336651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:57.337583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:57.344412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:57.345875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:05:57.357444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:05:57.358615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:05:57.359667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 625/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:05:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:05:57.364873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:57.425602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:57.467897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952bb06-0f0b-4f59-af75-ad9d8c6942e9 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:57.501647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:57.502269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:57.502549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:57.502821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:57.503503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:05:57.503807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:57.505221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd627f3e-4c0e-46d2-898a-7754a943535e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:57.517818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 647/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:05:57.523945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:05:57.616859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:05:57.626424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233fd1a-bed2-421d-aa66-08d089dda416 None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:05:57.659795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ef961-f1e5-4f15-a265-7ae2ce49ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:05:57.660438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef961-f1e5-4f15-a265-7ae2ce49ce68 None admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:57.660719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef961-f1e5-4f15-a265-7ae2ce49ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:57.660993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef961-f1e5-4f15-a265-7ae2ce49ce68 None admin] PATH_INFO: `/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/b0af289f07d14247a60083dcc34197a1/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:57.662886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ef961-f1e5-4f15-a265-7ae2ce49ce68 None admin] RBAC: Authorizing `identity:create_grant(project_id=89e61c14cd024865b7fb0bef59d89c0a, user_id=b0af289f07d14247a60083dcc34197a1, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:05:57.664325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ef961-f1e5-4f15-a265-7ae2ce49ce68 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:05:57.677629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 626/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Aug 30 00:05:57 2022] PUT /identity/v3/projects/89e61c14cd024865b7fb0bef59d89c0a/users/b0af289f07d14247a60083dcc34197a1/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:05:59.608919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67baa4-d956-43a9-9873-725419bfdbdf None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:59.609454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67baa4-d956-43a9-9873-725419bfdbdf None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:59.609454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67baa4-d956-43a9-9873-725419bfdbdf None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:59.610862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 648/1274] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:05:59.615870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:05:59.616288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:05:59.616423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:05:59.635105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:05:59.636305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:05:59.703214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 627/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:05:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:05:59.981580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67baa4-d956-43a9-9873-725419bfdbdf None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:00.082956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67baa4-d956-43a9-9873-725419bfdbdf None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:00.100230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:00.117579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:00.118272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:00.118562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:00.118834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:00.128777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 30 00:06:00.133547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:00.135515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:00.136411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 649/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Aug 30 00:05:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:00.141613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:00.223189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:00.241984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b536dd9-887a-45be-ade2-074554297dd7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:00.282305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:00.282926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:00.283212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:00.283480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:00.284176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:00.284466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:00.285869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:00.294897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 628/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Aug 30 00:06:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:00.302610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:00.409056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200ac7-4b2e-42aa-bc35-aa581326db64 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:00.448245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:00.448873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:00.449159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:00.449437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:00.459824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:00.461252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:06:00.476629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:00.477765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:06:00.478813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:06:00.478813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:06:00.478813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:00.478813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 650/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:00.486585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:00.588846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac8b14-5159-4b82-93ca-0dae4d9dd8ac None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:00.623787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:00.624468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:00.624672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:00.624952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:00.625603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:00.625941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:00.627316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:00.640032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 629/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:00.646396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:00.679135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:00.749099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d7759-589a-422f-9357-0b5743e15c59 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:00.787052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:00.787680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:00.787962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:00.788236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:00.796551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:00.798017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 30 00:06:00.809088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:00.810288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:00.811431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 651/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:06:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:00.816467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:00.820680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:00.917972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa2dac-7f24-4528-b509-8c5f1d419b8e None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:00.952278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:00.952882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:00.953163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:00.953436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:00.954199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:00.954508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:00.955934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:00.973399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 630/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Aug 30 00:06:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:00.979271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:01.069231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:01.083286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ab2961-5398-48c6-bf31-5f306dc51579 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:01.118321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:01.118965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:01.119314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:01.119593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:01.187661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:01.189109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:01.281195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:01.292583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 652/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Aug 30 00:06:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 30 00:06:01.298453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:01.359563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:01.403073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fbd443-c682-43a6-a4f1-b1dc44b3825a None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:01.437294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:01.437943 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:01.438225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:01.438497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:01.448585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:01.450054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 30 00:06:01.465020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:01.466132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 30 00:06:01.467409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 30 00:06:01.467409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 30 00:06:01.467409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:06:01.467409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 631/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:01.471962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:01.569753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009cfc2-d7d6-4451-815a-ca65f35311b8 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:01.604130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:01.604723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:01.605007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:01.605282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:01.605953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:01.606254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:01.607605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:01.618915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 653/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Aug 30 00:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:01.624596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:01.733922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f73e7-1000-477f-b604-b960cb1325ab None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:01.747699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:01.769412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:01.770068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:01.770349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:01.770620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:01.777804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:01.779234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 30 00:06:01.790287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:01.791453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: ERROR keystone.server.flask.application Aug 30 00:06:01.792455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 632/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Aug 30 00:06:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:01.798014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:01.848355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:01.902639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c274b11-8ae7-4f0b-aada-611e3f2e8c93 None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:01.937998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:01.938600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:01.938878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:01.939427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:01.940126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:01.940428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:01.941875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0779eb0e-ce19-4b65-8ea7-96b209a6cdae None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:01.955373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 654/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Aug 30 00:06:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:01.961594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:02.067052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d86e37-aba5-4267-9d0f-af156b8993ff None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:02.101724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:02.102329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:02.102677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:02.103137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:02.103980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] RBAC: Adding query filter params (role.id=46ba8574dccb497790ae947ec68f522d, scope.project.id=89e61c14cd024865b7fb0bef59d89c0a, user.id=b0af289f07d14247a60083dcc34197a1) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:02.104284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:02.105787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ec0ec-c09c-48b3-8ee5-2068b351e23d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:02.111384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 633/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Aug 30 00:06:01 2022] GET /identity/v3/role_assignments?user.id=b0af289f07d14247a60083dcc34197a1&scope.project.id=89e61c14cd024865b7fb0bef59d89c0a&role.id=46ba8574dccb497790ae947ec68f522d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:04.055523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75db7aa-7644-4038-892b-b8569aaccb39 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:04.056085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75db7aa-7644-4038-892b-b8569aaccb39 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:04.056248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75db7aa-7644-4038-892b-b8569aaccb39 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:04.057751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 655/1288] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:06:04.062988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:04.063471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:04.063575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:04.082167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:06:04.083351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:04.112802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:04.152520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 634/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:06:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:06:04.419953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75db7aa-7644-4038-892b-b8569aaccb39 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:04.522195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75db7aa-7644-4038-892b-b8569aaccb39 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:04.532868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:04.556573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:04.557275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:04.557553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:04.557859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:04.558441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:04.559789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:04.568426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:04.569603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:04.570471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 656/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:06:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:04.576554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:04.684351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1125dc4-ce8e-4399-8e88-b71b8b8b8ab0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:04.719171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:04.719779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:04.720061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:04.720335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:04.720974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:04.721281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:04.722680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e80331-f9c5-43b6-b467-c11d14816475 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:04.727594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 635/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 00:06:04 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:04.733350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:04.832319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec30b8c-1556-4416-9921-36d18e4c0a0e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:04.865565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:04.866201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:04.866486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:04.866761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] PATH_INFO: `/v3/services` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:04.867396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] RBAC: Adding query filter params (type=placement) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:04.867704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:04.869167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a0488-ba41-4e44-84ab-300d68dcea3f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:04.873751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 657/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 00:06:04 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:06.777017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d439e1f-df69-4b31-b0cb-533842a255f6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:06.777547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d439e1f-df69-4b31-b0cb-533842a255f6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:06.777547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d439e1f-df69-4b31-b0cb-533842a255f6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:06.778956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 636/1293] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:06:06.783964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb459-a520-47ae-b1c4-dc56905618c7 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:06.784338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb459-a520-47ae-b1c4-dc56905618c7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:06.784516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceb459-a520-47ae-b1c4-dc56905618c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:06.802461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-13ceb459-a520-47ae-b1c4-dc56905618c7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:06:06.803648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-13ceb459-a520-47ae-b1c4-dc56905618c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:06.833371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:06.871363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 658/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:06:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:06:07.136369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d439e1f-df69-4b31-b0cb-533842a255f6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:07.167828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:07.239169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d439e1f-df69-4b31-b0cb-533842a255f6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:07.275323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82c7a85-e0f8-4787-91bd-7074671e74fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:07.276277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a85-e0f8-4787-91bd-7074671e74fc None admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:07.276665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a85-e0f8-4787-91bd-7074671e74fc None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:07.277017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82c7a85-e0f8-4787-91bd-7074671e74fc None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:07.277837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c7a85-e0f8-4787-91bd-7074671e74fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:07.279477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82c7a85-e0f8-4787-91bd-7074671e74fc None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:07.297201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 637/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Aug 30 00:06:07 2022] POST /identity/v3/services => generated 246 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:06:09.213939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701a192-f7fd-49e2-9407-1fccc4fade90 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:09.214461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701a192-f7fd-49e2-9407-1fccc4fade90 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:09.214461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701a192-f7fd-49e2-9407-1fccc4fade90 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:09.215745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 659/1296] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:06:09.220866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:09.221265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:09.221415 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:09.239190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:06:09.240369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:09.319136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 638/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:06:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 30 00:06:09.586058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701a192-f7fd-49e2-9407-1fccc4fade90 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:09.685269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701a192-f7fd-49e2-9407-1fccc4fade90 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:09.718919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:09.719550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:09.719835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:09.720109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:09.720689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:09.722081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:09.730749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:09.731822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:09.732681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 660/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:06:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:09.737911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:09.756410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:09.836291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d93a-d25b-4557-bddb-a42e0d173c76 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:09.868754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:09.869340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:09.869617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:09.869913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:09.870538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:09.870838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:09.872186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:09.877171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 639/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 00:06:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:09.883152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:09.918947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:09.983801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b889a49-438e-4d8d-8a44-b7073de3c20f None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:10.016523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:10.017122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:10.017399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:10.017666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:10.018384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] RBAC: Adding query filter params (interface=public, service_id=741859c727d144ca9ca163b4c4c40bba, region_id=RegionOne) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:10.018689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:10.020033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e99954-9249-4bb3-8188-840f277d5a86 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:10.025681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 661/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Aug 30 00:06:09 2022] GET /identity/v3/endpoints?service_id=741859c727d144ca9ca163b4c4c40bba&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:10.031173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:10.110509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:10.128459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e420c-6960-479a-ad22-f8a2e82a699d None admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:10.162165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1fe1cc-3174-41f3-85ab-15dbba09900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:10.162756 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe1cc-3174-41f3-85ab-15dbba09900b None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:10.163037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe1cc-3174-41f3-85ab-15dbba09900b None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:10.163309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1fe1cc-3174-41f3-85ab-15dbba09900b None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:10.163905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fe1cc-3174-41f3-85ab-15dbba09900b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:10.165392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1fe1cc-3174-41f3-85ab-15dbba09900b None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:10.172326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 640/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Aug 30 00:06:10 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:06:12.102775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdfab0-0f66-424e-b6ba-549fdfe4be93 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:12.104057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdfab0-0f66-424e-b6ba-549fdfe4be93 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:12.104057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdfab0-0f66-424e-b6ba-549fdfe4be93 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:12.105261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 662/1302] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:06:12.110446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:12.110830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:12.111011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:12.128860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:06:12.130090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:06:12.194926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 641/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:06:12 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 30 00:06:12.471547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdfab0-0f66-424e-b6ba-549fdfe4be93 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:12.567779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:12.575212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdfab0-0f66-424e-b6ba-549fdfe4be93 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:12.610347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:12.610986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:12.611263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:12.611532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:12.612117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:12.613473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 30 00:06:12.626327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 30 00:06:12.627575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.get_or_create( Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application with Lock( Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self._enter() Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application return self.creator() Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application created_value = creator( Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: ERROR keystone.server.flask.application Aug 30 00:06:12.628588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 663/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Aug 30 00:06:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 30 00:06:12.636664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:12.714278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:12.737047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200a76-a4c9-44ba-836a-a015c406ecd6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:12.771566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:12.772168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:12.772453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:12.772729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] PATH_INFO: `/v3/services` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:12.773368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:06:12.773675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:12.775203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78823231-fee2-487d-9a4d-9bc4860f1262 None admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:12.780327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 642/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Aug 30 00:06:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:06:12.786108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:06:12.898703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a967ff0-a11d-49d5-bd18-89bc54ce991e None admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:06:12.939242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab13748-1301-45dd-952a-0e952dc22b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:06:12.939839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab13748-1301-45dd-952a-0e952dc22b32 None admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:06:12.940118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab13748-1301-45dd-952a-0e952dc22b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:06:12.940389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab13748-1301-45dd-952a-0e952dc22b32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:06:12.941054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab13748-1301-45dd-952a-0e952dc22b32 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:06:12.942438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab13748-1301-45dd-952a-0e952dc22b32 None admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:06:12.961804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 664/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:06:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:06:22.777378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=30 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:06:22.957359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:18.721485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bc9a-7cb8-40a7-9a14-e7b13e56c6f6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.722574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bc9a-7cb8-40a7-9a14-e7b13e56c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.723092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1bc9a-7cb8-40a7-9a14-e7b13e56c6f6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.728535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 643/1307] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:18.729944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f65c85-38d3-43cc-96b7-7b7517d65a4d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:18.730364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f65c85-38d3-43cc-96b7-7b7517d65a4d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:18.730531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f65c85-38d3-43cc-96b7-7b7517d65a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:18.833822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e1f65c85-38d3-43cc-96b7-7b7517d65a4d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:18.835037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e1f65c85-38d3-43cc-96b7-7b7517d65a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:18.972199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 665/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:19.285766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0aada-43eb-4f82-923b-5d3ec02c854a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.286205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0aada-43eb-4f82-923b-5d3ec02c854a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.286592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0aada-43eb-4f82-923b-5d3ec02c854a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.288082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 644/1309] 10.222.0.43 () {54 vars in 965 bytes} [Tue Aug 30 00:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:19.295422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ccca8-8d7c-47ed-92ea-fabaa8a376d4 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.295714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ccca8-8d7c-47ed-92ea-fabaa8a376d4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.295990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ccca8-8d7c-47ed-92ea-fabaa8a376d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.378641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-dc1ccca8-8d7c-47ed-92ea-fabaa8a376d4 None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:19.379841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dc1ccca8-8d7c-47ed-92ea-fabaa8a376d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:19.402371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:19.463744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 666/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 00:07:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:19.474654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0aada-43eb-4f82-923b-5d3ec02c854a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:19.476605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-44b0aada-43eb-4f82-923b-5d3ec02c854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:19.600377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0aada-43eb-4f82-923b-5d3ec02c854a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:19.681666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:19.682305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:19.682595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:19.682872 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:19.684551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:19.744203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:19.803434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:19.804888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340c147-6352-467a-a316-54cbcbb71c93 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:19.825330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 645/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:07:22.060587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330297-5d17-41da-8a53-b04176edc1ff None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:22.061129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330297-5d17-41da-8a53-b04176edc1ff None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:22.061644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e330297-5d17-41da-8a53-b04176edc1ff None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:22.063080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 667/1312] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:22.069394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7e67-61af-4826-bcdb-f0c963a9afd5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:22.069394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7e67-61af-4826-bcdb-f0c963a9afd5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:22.069845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe7e67-61af-4826-bcdb-f0c963a9afd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:22.153472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-29fe7e67-61af-4826-bcdb-f0c963a9afd5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:22.154760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-29fe7e67-61af-4826-bcdb-f0c963a9afd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:22.261055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 646/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:07:22.547182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330297-5d17-41da-8a53-b04176edc1ff None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:22.548726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1e330297-5d17-41da-8a53-b04176edc1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:22.656638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e330297-5d17-41da-8a53-b04176edc1ff None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:22.729287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:22.733001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:22.733788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:22.734235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:22.734514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:22.736107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:22.848012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:22.849623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da31574-08ff-47fe-86ba-20b916c0966a service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:22.872327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 668/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:25.103743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2981-2b99-421c-925b-9530f0e73606 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:25.104291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2981-2b99-421c-925b-9530f0e73606 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:25.104291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c2981-2b99-421c-925b-9530f0e73606 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:25.105651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 647/1315] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:25.111065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31552c-d9ca-4c03-b298-c0781d39235f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:25.111511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31552c-d9ca-4c03-b298-c0781d39235f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:25.111644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31552c-d9ca-4c03-b298-c0781d39235f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:25.178281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5f31552c-d9ca-4c03-b298-c0781d39235f None None] MFA Rules not processed for user `29687ec14c104869a1721c16fabdef06`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:25.179419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5f31552c-d9ca-4c03-b298-c0781d39235f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:25.232709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:25.278278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 669/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:25 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:25.568454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2981-2b99-421c-925b-9530f0e73606 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:25.570025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-589c2981-2b99-421c-925b-9530f0e73606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:25.580246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:25.673541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c2981-2b99-421c-925b-9530f0e73606 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:25.743819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:25.744413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:25.744694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:25.744968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:25.746613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:25.807234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:25.854065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:25.855428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48e76a-e61e-49fd-b4f3-5eee81250fa3 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:25.872892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 648/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:25 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:28.365498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741960-6ff8-4efa-a652-eb4da562b63a None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:28.366054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741960-6ff8-4efa-a652-eb4da562b63a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:28.366054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05741960-6ff8-4efa-a652-eb4da562b63a None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:28.367420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 670/1318] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:28.372985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d74d6-a0fa-49da-8946-50ab0dc0576a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:28.373442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d74d6-a0fa-49da-8946-50ab0dc0576a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:28.373543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d74d6-a0fa-49da-8946-50ab0dc0576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:28.438710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-015d74d6-a0fa-49da-8946-50ab0dc0576a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:28.439918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-015d74d6-a0fa-49da-8946-50ab0dc0576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:28.536206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 649/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:28.820114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05741960-6ff8-4efa-a652-eb4da562b63a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:28.821747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-05741960-6ff8-4efa-a652-eb4da562b63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:28.926286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05741960-6ff8-4efa-a652-eb4da562b63a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:29.008259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:29.008259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:29.008259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:29.008259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:29.008777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:29.017141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:29.126307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:29.127767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030dab5-7832-40fb-90ef-69e8f10a1143 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:29.147125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 671/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:31.828839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44f32-1a6e-4b33-b0ef-609751b27116 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:31.829407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44f32-1a6e-4b33-b0ef-609751b27116 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:31.829407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c44f32-1a6e-4b33-b0ef-609751b27116 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:31.830806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 650/1321] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:31.836010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720d20c-c103-4149-b19c-259824edb682 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:31.836423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720d20c-c103-4149-b19c-259824edb682 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:31.836699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720d20c-c103-4149-b19c-259824edb682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:31.904585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e720d20c-c103-4149-b19c-259824edb682 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:31.905834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e720d20c-c103-4149-b19c-259824edb682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:31.969886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.010674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 672/1322] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:32.298524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44f32-1a6e-4b33-b0ef-609751b27116 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:32.300058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-32c44f32-1a6e-4b33-b0ef-609751b27116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:32.319638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.407794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c44f32-1a6e-4b33-b0ef-609751b27116 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:32.480529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:32.481674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:32.482014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:32.482241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:32.483931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:32.556370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:32.594377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:32.595809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28e51c-1beb-46ec-a185-7d665dd78f71 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:32.613918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 651/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:34.592983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748190de-6f97-4697-8645-637f99251e79 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:34.593506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748190de-6f97-4697-8645-637f99251e79 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:34.593506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748190de-6f97-4697-8645-637f99251e79 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:34.594835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 673/1324] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:34.600207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979616f2-1ff4-466b-a70c-90bad71a5df6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:34.600638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979616f2-1ff4-466b-a70c-90bad71a5df6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:34.600741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979616f2-1ff4-466b-a70c-90bad71a5df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:34.667320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-979616f2-1ff4-466b-a70c-90bad71a5df6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:34.668524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-979616f2-1ff4-466b-a70c-90bad71a5df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:34.767520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 652/1325] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:35.051748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748190de-6f97-4697-8645-637f99251e79 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:35.053295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-748190de-6f97-4697-8645-637f99251e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:35.158069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748190de-6f97-4697-8645-637f99251e79 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:35.244288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:35.244928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:35.245214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:35.245493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:35.247171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:35.266180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:35.361054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:35.362513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6369575c-6beb-4a3a-b79d-deb4323f7690 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:35.380255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 674/1326] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:37.358108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff29c-92da-41c4-a8f0-bfc61587f312 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:37.358651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff29c-92da-41c4-a8f0-bfc61587f312 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:37.358651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acff29c-92da-41c4-a8f0-bfc61587f312 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:37.359934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 653/1327] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:07:37.365352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31b9a-f590-434c-8c4d-0e232433416a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:37.365829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31b9a-f590-434c-8c4d-0e232433416a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:37.365920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b31b9a-f590-434c-8c4d-0e232433416a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:37.436969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-70b31b9a-f590-434c-8c4d-0e232433416a None None] MFA Rules not processed for user `29687ec14c104869a1721c16fabdef06`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:37.438244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-70b31b9a-f590-434c-8c4d-0e232433416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:37.506200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:37.538682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 675/1328] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:37.824248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff29c-92da-41c4-a8f0-bfc61587f312 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:37.827671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0acff29c-92da-41c4-a8f0-bfc61587f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:37.880979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:37.960222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acff29c-92da-41c4-a8f0-bfc61587f312 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:38.036799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:38.037402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:38.037685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:38.038736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:38.039631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:38.119108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:38.151077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:38.152508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4290eab6-980c-489c-98e1-3a14a70b90d5 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:38.171516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 654/1329] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:40.344875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b832dd-828d-42c9-a6d7-33d64b641593 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.345289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b832dd-828d-42c9-a6d7-33d64b641593 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.345553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b832dd-828d-42c9-a6d7-33d64b641593 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.346843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 676/1330] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:40.352010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da37a-48ef-4a0a-85e7-837be3cafc8e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.352420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da37a-48ef-4a0a-85e7-837be3cafc8e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.352666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7da37a-48ef-4a0a-85e7-837be3cafc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.421175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9c7da37a-48ef-4a0a-85e7-837be3cafc8e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:40.422448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9c7da37a-48ef-4a0a-85e7-837be3cafc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:40.520694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 655/1331] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:40.808357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b832dd-828d-42c9-a6d7-33d64b641593 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:40.810556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-15b832dd-828d-42c9-a6d7-33d64b641593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:40.911632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b832dd-828d-42c9-a6d7-33d64b641593 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:40.988771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:40.989378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:40.989667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:40.989976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:40.991566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:41.017633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:41.098516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:41.099855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57666194-e4e5-40af-9f0d-f7de02e5280c service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:41.117931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 677/1332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:43.057988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced19606-693a-4058-a7b7-5bc701bec3a9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:43.058535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced19606-693a-4058-a7b7-5bc701bec3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:43.058535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced19606-693a-4058-a7b7-5bc701bec3a9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:43.060557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 656/1333] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:43.065985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac76e-e56f-461c-9a49-0906b100ed39 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:43.066412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac76e-e56f-461c-9a49-0906b100ed39 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:43.066541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ac76e-e56f-461c-9a49-0906b100ed39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:43.131439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b14ac76e-e56f-461c-9a49-0906b100ed39 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:43.132646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b14ac76e-e56f-461c-9a49-0906b100ed39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:43.205152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:43.228002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 678/1334] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:07:43.520451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced19606-693a-4058-a7b7-5bc701bec3a9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:43.522025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ced19606-693a-4058-a7b7-5bc701bec3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:43.562304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:43.625781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced19606-693a-4058-a7b7-5bc701bec3a9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:43.697687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:43.698319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:43.698604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:43.698905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:43.701198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:43.783651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:43.809111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:43.810803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f8f4ef-0071-4667-995c-de1085a48f8b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:43.829049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 657/1335] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:46.072515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899da1-850b-47d6-b5c7-5b5f32a30623 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:46.073070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899da1-850b-47d6-b5c7-5b5f32a30623 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:46.073070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a899da1-850b-47d6-b5c7-5b5f32a30623 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:46.074446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 679/1336] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:46.079781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefe853-064b-439f-89c3-31a5b3e89b9a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:46.080203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefe853-064b-439f-89c3-31a5b3e89b9a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:46.080338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefe853-064b-439f-89c3-31a5b3e89b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:46.146627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7eefe853-064b-439f-89c3-31a5b3e89b9a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:46.147825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7eefe853-064b-439f-89c3-31a5b3e89b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:46.243677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 658/1337] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:46.525753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899da1-850b-47d6-b5c7-5b5f32a30623 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:46.527300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9a899da1-850b-47d6-b5c7-5b5f32a30623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:46.629391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a899da1-850b-47d6-b5c7-5b5f32a30623 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:46.702128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:46.702721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:46.703001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:46.703272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:46.704864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:46.740749 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:46.813690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:46.815071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dad5c4-9724-4d7c-9f37-60cbe1e60fa6 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:46.833296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 680/1338] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:50.665809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d381cd6-ff55-4246-8f21-681e325314f0 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:50.666347 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d381cd6-ff55-4246-8f21-681e325314f0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:50.666347 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d381cd6-ff55-4246-8f21-681e325314f0 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:50.671425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 659/1339] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:50.673513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c76c-0a9e-48b7-9f62-e7077a7f47e0 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:50.674030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c76c-0a9e-48b7-9f62-e7077a7f47e0 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:50.674277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120c76c-0a9e-48b7-9f62-e7077a7f47e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:50.742498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d120c76c-0a9e-48b7-9f62-e7077a7f47e0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:50.743701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d120c76c-0a9e-48b7-9f62-e7077a7f47e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:50.829666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:50.841683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 681/1340] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:51.140057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300fd2-1c0d-48e7-8782-c0bfa2d33ee3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:51.140348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300fd2-1c0d-48e7-8782-c0bfa2d33ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:51.140630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d300fd2-1c0d-48e7-8782-c0bfa2d33ee3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:51.142022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 660/1341] 10.222.0.43 () {54 vars in 965 bytes} [Tue Aug 30 00:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:51.148231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea174-efb6-48f1-93d6-32952aae5672 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:51.148595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea174-efb6-48f1-93d6-32952aae5672 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:51.148942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea174-efb6-48f1-93d6-32952aae5672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:51.225889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ba0ea174-efb6-48f1-93d6-32952aae5672 None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:51.227095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ba0ea174-efb6-48f1-93d6-32952aae5672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:51.306879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 682/1342] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Aug 30 00:07:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:07:51.316068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300fd2-1c0d-48e7-8782-c0bfa2d33ee3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:51.317687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8d300fd2-1c0d-48e7-8782-c0bfa2d33ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:51.366465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:51.424317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d300fd2-1c0d-48e7-8782-c0bfa2d33ee3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:51.498646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:51.499255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:51.499534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:51.499802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:51.501389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:51.596646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:51.614235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:51.615667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c88a28-409a-4d4b-9020-81364a1934f9 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:51.633961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 661/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:54.817685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90e4a4-d150-4c0f-b29e-179a240ef6e5 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.818355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90e4a4-d150-4c0f-b29e-179a240ef6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.818355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a90e4a4-d150-4c0f-b29e-179a240ef6e5 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.819607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 683/1344] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:54.824697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fc5f-0f2c-40b4-bb1d-0faf1e86cf0c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:54.825145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fc5f-0f2c-40b4-bb1d-0faf1e86cf0c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:54.825250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fc5f-0f2c-40b4-bb1d-0faf1e86cf0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:54.894259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9a52fc5f-0f2c-40b4-bb1d-0faf1e86cf0c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:54.895691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a52fc5f-0f2c-40b4-bb1d-0faf1e86cf0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:55.000490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 662/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:07:55.281912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90e4a4-d150-4c0f-b29e-179a240ef6e5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:07:55.283460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9a90e4a4-d150-4c0f-b29e-179a240ef6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:55.390370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:55.412842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a90e4a4-d150-4c0f-b29e-179a240ef6e5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:07:55.496976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:07:55.497666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:55.498112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:55.498394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:55.500053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:55.616547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:07:55.618030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628df3a3-191d-4556-b6e1-2b90f2dfc440 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:07:55.637087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 684/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:07:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:07:59.805469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daf1fc-5760-42f0-96b9-837aaafc6a76 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:59.806085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daf1fc-5760-42f0-96b9-837aaafc6a76 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:59.806085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87daf1fc-5760-42f0-96b9-837aaafc6a76 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:59.807420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 663/1347] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:07:59.813534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074b67-b83b-4e44-82e8-8621d6d5ab1d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:07:59.814040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074b67-b83b-4e44-82e8-8621d6d5ab1d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:07:59.814138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb074b67-b83b-4e44-82e8-8621d6d5ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:07:59.831556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:07:59.887441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-fb074b67-b83b-4e44-82e8-8621d6d5ab1d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:07:59.889633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fb074b67-b83b-4e44-82e8-8621d6d5ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:07:59.995657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 685/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:00.287949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daf1fc-5760-42f0-96b9-837aaafc6a76 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:00.289518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-87daf1fc-5760-42f0-96b9-837aaafc6a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:00.346164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:00.396776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87daf1fc-5760-42f0-96b9-837aaafc6a76 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:00.475225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:00.475806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:00.476087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:00.476362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:00.477995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:00.588526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:00.592074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:00.594519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f88bc-d026-467e-ba5c-1cfd04e89146 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:00.613919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 664/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:05.526744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c909dcc-4952-422c-a80b-aa80a85df23f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:05.527147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c909dcc-4952-422c-a80b-aa80a85df23f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:05.527147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c909dcc-4952-422c-a80b-aa80a85df23f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:05.528673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 686/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:05.534289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeec25-7c4f-481e-810b-98d631730aca None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:05.534701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeec25-7c4f-481e-810b-98d631730aca None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:05.534909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeec25-7c4f-481e-810b-98d631730aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:05.627306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f1aeec25-7c4f-481e-810b-98d631730aca None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:05.629073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f1aeec25-7c4f-481e-810b-98d631730aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:05.786722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 665/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:08:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:09.929561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf76055-3d9d-462a-a73a-67161df90b57 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:09.930052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf76055-3d9d-462a-a73a-67161df90b57 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:09.930153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf76055-3d9d-462a-a73a-67161df90b57 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:09.931690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 687/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:09.937341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4969c-bfa2-4279-ba43-86b423766392 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:09.937787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4969c-bfa2-4279-ba43-86b423766392 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:09.937936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4969c-bfa2-4279-ba43-86b423766392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:09.992848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=59 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:09.997676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:10.024011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-98f4969c-bfa2-4279-ba43-86b423766392 None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:10.025382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-98f4969c-bfa2-4279-ba43-86b423766392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:10.140058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 666/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:08:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:11.604880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9287-5735-4dd9-b2d3-9a934e2223a4 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:11.605393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9287-5735-4dd9-b2d3-9a934e2223a4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:11.605393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa9287-5735-4dd9-b2d3-9a934e2223a4 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:11.606779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 688/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:11.612562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e8f-a70f-45f2-89dd-ab7d31f8ec8b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:11.613010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e8f-a70f-45f2-89dd-ab7d31f8ec8b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:11.613237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79302e8f-a70f-45f2-89dd-ab7d31f8ec8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:11.691598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-79302e8f-a70f-45f2-89dd-ab7d31f8ec8b None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:11.692792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-79302e8f-a70f-45f2-89dd-ab7d31f8ec8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:11.735911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:11.803257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 667/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:08:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:15.096308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155b20-4670-4e87-98be-b77a59e87970 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:15.096886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155b20-4670-4e87-98be-b77a59e87970 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:15.096982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73155b20-4670-4e87-98be-b77a59e87970 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:15.098358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 689/1356] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:15.103708 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2300e-5c92-4706-8077-91f237de3403 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:15.104115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2300e-5c92-4706-8077-91f237de3403 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:15.104334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2300e-5c92-4706-8077-91f237de3403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:15.183725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c8f2300e-5c92-4706-8077-91f237de3403 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:15.184865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c8f2300e-5c92-4706-8077-91f237de3403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:15.328997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 668/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:15.639212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f74f6-8394-4878-a4e6-fd60d8e59bf9 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:15.639503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f74f6-8394-4878-a4e6-fd60d8e59bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:15.639873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f74f6-8394-4878-a4e6-fd60d8e59bf9 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:15.641221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 690/1358] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 00:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:15.651689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7dab3-da05-4581-aa86-094b0d2114d5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:15.652336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7dab3-da05-4581-aa86-094b0d2114d5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:15.652905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7dab3-da05-4581-aa86-094b0d2114d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:15.691803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:15.761563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-39e7dab3-da05-4581-aa86-094b0d2114d5 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:15.762902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-39e7dab3-da05-4581-aa86-094b0d2114d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:15.889453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 669/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 00:08:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:15.897965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f74f6-8394-4878-a4e6-fd60d8e59bf9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:15.899605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-909f74f6-8394-4878-a4e6-fd60d8e59bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:16.059652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f74f6-8394-4878-a4e6-fd60d8e59bf9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:16.139253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:16.184147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:16.184823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:16.185215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:16.185604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:16.188066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:16.286197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:16.288317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fec4d-5dbd-4b95-ae40-5ed0adb34464 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:16.307752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 691/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:08:18.439189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87407f5-4310-4907-af5c-8f57af402d74 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:18.439709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87407f5-4310-4907-af5c-8f57af402d74 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:18.439709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87407f5-4310-4907-af5c-8f57af402d74 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:18.441055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 670/1361] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:18.446227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e407a-5ce8-4279-8719-c858df892a8d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:18.446652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e407a-5ce8-4279-8719-c858df892a8d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:18.446793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e407a-5ce8-4279-8719-c858df892a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:18.516255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-029e407a-5ce8-4279-8719-c858df892a8d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:18.517464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-029e407a-5ce8-4279-8719-c858df892a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:18.557585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:18.626505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 692/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:18.929968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87407f5-4310-4907-af5c-8f57af402d74 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:18.933944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d87407f5-4310-4907-af5c-8f57af402d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:19.004597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:19.096457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87407f5-4310-4907-af5c-8f57af402d74 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:19.230589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:19.231215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:19.231614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:19.231966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:19.234497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:19.262543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:19.351063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:19.352742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fcb26-94ff-4d17-bb94-a0aeae8203e6 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:19.374665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 671/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:21.653814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408feaf-39df-4056-8c74-3a32600fe878 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:21.654341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408feaf-39df-4056-8c74-3a32600fe878 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:21.654464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408feaf-39df-4056-8c74-3a32600fe878 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:21.655769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 693/1364] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:21.661413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33292-d3b5-4b60-a63c-665f1b8a118e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:21.661871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33292-d3b5-4b60-a63c-665f1b8a118e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:21.662174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33292-d3b5-4b60-a63c-665f1b8a118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:21.733699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-57a33292-d3b5-4b60-a63c-665f1b8a118e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:21.735053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-57a33292-d3b5-4b60-a63c-665f1b8a118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:21.836655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:21.848928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 672/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:22.132116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685de6e-d85b-4700-a5e2-a6b410a6c038 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:22.132524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685de6e-d85b-4700-a5e2-a6b410a6c038 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:22.132920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685de6e-d85b-4700-a5e2-a6b410a6c038 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:22.134550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 694/1366] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 00:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:22.140763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5970bc-6dc8-4431-91fe-f9d2256b31fb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:22.141204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5970bc-6dc8-4431-91fe-f9d2256b31fb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:22.141485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5970bc-6dc8-4431-91fe-f9d2256b31fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:22.222717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2d5970bc-6dc8-4431-91fe-f9d2256b31fb None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:22.223847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2d5970bc-6dc8-4431-91fe-f9d2256b31fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:22.350828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 673/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 00:08:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:22.359494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685de6e-d85b-4700-a5e2-a6b410a6c038 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:22.361224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0685de6e-d85b-4700-a5e2-a6b410a6c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:22.528628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685de6e-d85b-4700-a5e2-a6b410a6c038 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:22.555343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:22.660336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:22.660995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:22.661301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:22.661500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:22.663192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:22.765339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:22.767553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c48291-e826-49d2-9008-1114855f7f24 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:22.792938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 695/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:23.392490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99835-967e-4d8b-a1f4-45789dfe57d4 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:23.393375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99835-967e-4d8b-a1f4-45789dfe57d4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:23.393658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b99835-967e-4d8b-a1f4-45789dfe57d4 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:23.395587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 674/1369] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:23.400897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaece5c-eb75-414f-9874-418415b8c2e2 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:23.401191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaece5c-eb75-414f-9874-418415b8c2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:23.401471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaece5c-eb75-414f-9874-418415b8c2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:23.436299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:23.475496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-bfaece5c-eb75-414f-9874-418415b8c2e2 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:23.476720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bfaece5c-eb75-414f-9874-418415b8c2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:23.580165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 696/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:24.160474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268ddf9-6a75-466c-8983-6c94823f0f41 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:24.160474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268ddf9-6a75-466c-8983-6c94823f0f41 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:24.160474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268ddf9-6a75-466c-8983-6c94823f0f41 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:24.162161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 675/1371] 10.222.0.43 () {54 vars in 964 bytes} [Tue Aug 30 00:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:24.166921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4082e75-fc91-4f92-b3b6-d9b6e6350599 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:24.167379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4082e75-fc91-4f92-b3b6-d9b6e6350599 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:24.167649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4082e75-fc91-4f92-b3b6-d9b6e6350599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:24.258414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b4082e75-fc91-4f92-b3b6-d9b6e6350599 None None] MFA Rules not processed for user `0f458d5fcb964638be06e1bf21869250`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:24.259637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b4082e75-fc91-4f92-b3b6-d9b6e6350599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:24.315510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:24.351852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 697/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Aug 30 00:08:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:08:24.360508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268ddf9-6a75-466c-8983-6c94823f0f41 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:24.362050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e268ddf9-6a75-466c-8983-6c94823f0f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:24.426581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:24.488209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268ddf9-6a75-466c-8983-6c94823f0f41 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:24.575446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:24.576215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:24.576608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:24.577596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:24.579764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:24.703721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:24.724313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:24.727908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14971c1c-1c6a-4751-a484-d256911ee62b service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:24.756165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 676/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:24.854413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b254-2aea-4823-855d-16be4bea6a6f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:24.854708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b254-2aea-4823-855d-16be4bea6a6f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:24.854994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339b254-2aea-4823-855d-16be4bea6a6f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:24.856354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 698/1374] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:24.861997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d68e-5af3-45e4-b778-42f1078e697f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:24.862287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d68e-5af3-45e4-b778-42f1078e697f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:24.862562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33d68e-5af3-45e4-b778-42f1078e697f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:24.947362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fb33d68e-5af3-45e4-b778-42f1078e697f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:24.948583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fb33d68e-5af3-45e4-b778-42f1078e697f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:25.046538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 677/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:25.340167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b254-2aea-4823-855d-16be4bea6a6f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:25.341695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9339b254-2aea-4823-855d-16be4bea6a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:25.495277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339b254-2aea-4823-855d-16be4bea6a6f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:25.548710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:25.611108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:25.611644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:25.611921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:25.612191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:25.613841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:25.706387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:25.707984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca027f-498d-4899-a424-2a98df96ff1e service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:25.725798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 699/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:27.680690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715689-c8a2-42f3-bf69-ce5c1a311d7e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:27.681189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715689-c8a2-42f3-bf69-ce5c1a311d7e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:27.681280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e715689-c8a2-42f3-bf69-ce5c1a311d7e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:27.682618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 678/1377] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:27.688636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd71b-0a78-41be-8ad0-fbac7020f269 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:27.689033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd71b-0a78-41be-8ad0-fbac7020f269 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:27.689184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2fd71b-0a78-41be-8ad0-fbac7020f269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:27.761698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-0d2fd71b-0a78-41be-8ad0-fbac7020f269 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:27.763061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0d2fd71b-0a78-41be-8ad0-fbac7020f269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:27.770893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:27.884139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 700/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:08:28.184957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715689-c8a2-42f3-bf69-ce5c1a311d7e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:28.189677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1e715689-c8a2-42f3-bf69-ce5c1a311d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:28.275752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:28.410718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e715689-c8a2-42f3-bf69-ce5c1a311d7e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:28.534382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:28.535256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:28.535767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:28.536206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:28.538137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:28.560217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:28.642142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:28.643746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9f0fc-611d-485c-a8a8-c6bb279f7574 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:28.665885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 679/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:30.694170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea32ab-7e86-402d-81ed-1244c3edeef4 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:30.694652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea32ab-7e86-402d-81ed-1244c3edeef4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:30.694743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebea32ab-7e86-402d-81ed-1244c3edeef4 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:30.696433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 701/1380] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:30.701496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60fdf-9802-459e-924a-af11ffe7f587 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:30.702038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60fdf-9802-459e-924a-af11ffe7f587 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:30.702758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60fdf-9802-459e-924a-af11ffe7f587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:30.775998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-84e60fdf-9802-459e-924a-af11ffe7f587 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:30.777349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-84e60fdf-9802-459e-924a-af11ffe7f587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:30.878318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:30.885741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 680/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:31.181006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea32ab-7e86-402d-81ed-1244c3edeef4 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:31.182600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ebea32ab-7e86-402d-81ed-1244c3edeef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:31.344197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:31.359952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebea32ab-7e86-402d-81ed-1244c3edeef4 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:31.491164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:31.491691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:31.491964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:31.492233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:31.493933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:31.590967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:31.592586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e1da1-f2a1-40c6-bcfb-938d60eb85d0 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:31.604525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:31.614149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 702/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:33.578471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6cb3-8b9a-4e40-a882-690c903503e6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:33.579051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6cb3-8b9a-4e40-a882-690c903503e6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:33.579202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda6cb3-8b9a-4e40-a882-690c903503e6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:33.581049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 681/1383] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:33.586339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686948ae-dd15-471b-87e4-28604933bbd4 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:33.586836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686948ae-dd15-471b-87e4-28604933bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:33.586983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686948ae-dd15-471b-87e4-28604933bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:33.655706 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-686948ae-dd15-471b-87e4-28604933bbd4 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:33.657125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-686948ae-dd15-471b-87e4-28604933bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:33.766814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 703/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:34.053515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda6cb3-8b9a-4e40-a882-690c903503e6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:34.055190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9eda6cb3-8b9a-4e40-a882-690c903503e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:34.225066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda6cb3-8b9a-4e40-a882-690c903503e6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:34.296634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:34.342508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:34.343621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:34.343896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:34.344171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:34.345778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:34.440594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:34.442266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c01176-df33-48c9-90b4-3c80b3427161 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:34.461202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 682/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:36.618500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91aa3f-b57f-4189-992b-79bd0d691fda None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:36.619040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91aa3f-b57f-4189-992b-79bd0d691fda None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:36.619221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91aa3f-b57f-4189-992b-79bd0d691fda None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:36.621245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 704/1386] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:36.627637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629f72e-ae13-40b3-b764-6aa34a3337b1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:36.628099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629f72e-ae13-40b3-b764-6aa34a3337b1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:36.628221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629f72e-ae13-40b3-b764-6aa34a3337b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:36.695320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1629f72e-ae13-40b3-b764-6aa34a3337b1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:36.696534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1629f72e-ae13-40b3-b764-6aa34a3337b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:36.729687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:36.801072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 683/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:37.088927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91aa3f-b57f-4189-992b-79bd0d691fda None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:37.090618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7f91aa3f-b57f-4189-992b-79bd0d691fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:37.176110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:37.259880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91aa3f-b57f-4189-992b-79bd0d691fda None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:37.390126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:37.391291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:37.391646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:37.391978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:37.394053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:37.443067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:37.498183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:37.499897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f5868-17d7-499b-9334-8f37823f767b service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:37.519176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 705/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:39.469818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec74d2-e198-4f16-8976-10a95a624da5 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:39.470357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec74d2-e198-4f16-8976-10a95a624da5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:39.470357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec74d2-e198-4f16-8976-10a95a624da5 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:39.471704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 684/1389] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:39.476814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e9bd-9819-4aea-b5df-fed988092a7c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:39.477234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e9bd-9819-4aea-b5df-fed988092a7c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:39.477372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f3e9bd-9819-4aea-b5df-fed988092a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:39.543365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c6f3e9bd-9819-4aea-b5df-fed988092a7c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:39.544556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c6f3e9bd-9819-4aea-b5df-fed988092a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:39.644852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 706/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:39.939157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec74d2-e198-4f16-8976-10a95a624da5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:39.940788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0fec74d2-e198-4f16-8976-10a95a624da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.085848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838703e-baa2-4475-b190-b3b90483cb3f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.086246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838703e-baa2-4475-b190-b3b90483cb3f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.086524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838703e-baa2-4475-b190-b3b90483cb3f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.087874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 707/1391] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:08:40.089524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec74d2-e198-4f16-8976-10a95a624da5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:40.092997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eea7-0220-4b2c-9515-0d2e915c0f1d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.093949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eea7-0220-4b2c-9515-0d2e915c0f1d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.094220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d5eea7-0220-4b2c-9515-0d2e915c0f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.109743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.112135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.165270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-49d5eea7-0220-4b2c-9515-0d2e915c0f1d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:40.166519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-49d5eea7-0220-4b2c-9515-0d2e915c0f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.213641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:40.214200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.214469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.214737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.216338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.269145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 708/1392] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:08:40.309473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:40.311130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd68126-358a-4133-87bd-7e7d18857cb2 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:40.330772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 685/1393] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:40.592302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3551-add2-49b3-9057-1282351eabba None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.592789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3551-add2-49b3-9057-1282351eabba None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.592869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc3551-add2-49b3-9057-1282351eabba None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.594276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 709/1394] 10.222.0.43 () {54 vars in 967 bytes} [Tue Aug 30 00:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:40.599493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c01b-37fd-40e3-afaf-e745de7dff58 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.599910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c01b-37fd-40e3-afaf-e745de7dff58 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.600195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2c01b-37fd-40e3-afaf-e745de7dff58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.628051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.688503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-55d2c01b-37fd-40e3-afaf-e745de7dff58 None None] MFA Rules not processed for user `274f72b3a3c34d6388ff820627f2f4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:40.689797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-55d2c01b-37fd-40e3-afaf-e745de7dff58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.771183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 686/1395] 10.222.0.43 () {58 vars in 1064 bytes} [Tue Aug 30 00:08:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:40.779431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3551-add2-49b3-9057-1282351eabba None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:40.781025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c1fc3551-add2-49b3-9057-1282351eabba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:40.892074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:40.900081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc3551-add2-49b3-9057-1282351eabba None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:40.978161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:40.978765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:40.979042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:40.979308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:40.981048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:41.093678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:41.095097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a716dc-c4b2-4f53-aa91-9cc9a447ba57 service glance] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:41.113512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 710/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:41.862558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9d7b-f15f-474d-ae2f-3198c0f9e479 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:41.863063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9d7b-f15f-474d-ae2f-3198c0f9e479 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:41.863179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b9d7b-f15f-474d-ae2f-3198c0f9e479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:41.934598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d70b9d7b-f15f-474d-ae2f-3198c0f9e479 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:41.935813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d70b9d7b-f15f-474d-ae2f-3198c0f9e479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:41.995417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:42.024245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 687/1397] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:08:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:42.067504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615df63-499b-4123-b7e9-384af2158af5 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:42.068003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615df63-499b-4123-b7e9-384af2158af5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:42.068097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615df63-499b-4123-b7e9-384af2158af5 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:42.069432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 711/1398] 10.222.0.43 () {54 vars in 943 bytes} [Tue Aug 30 00:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:42.075675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f66b0-6fae-4e37-9113-7e1277464869 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:42.076023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f66b0-6fae-4e37-9113-7e1277464869 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:42.076305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f66b0-6fae-4e37-9113-7e1277464869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:42.154988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c58f66b0-6fae-4e37-9113-7e1277464869 None None] MFA Rules not processed for user `5be0312450644dd69a7c7263e347b28b`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:42.156750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c58f66b0-6fae-4e37-9113-7e1277464869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:42.262050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 688/1399] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Aug 30 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:42.271817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615df63-499b-4123-b7e9-384af2158af5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:42.273322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c615df63-499b-4123-b7e9-384af2158af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:42.298248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e054f5-c59b-4af1-a1bd-5766ea8ba5b4 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:42.298545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e054f5-c59b-4af1-a1bd-5766ea8ba5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:42.298830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e054f5-c59b-4af1-a1bd-5766ea8ba5b4 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:42.299888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:42.300463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 689/1400] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:42.305538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:42.305858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:42.306142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:42.352276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:42.374227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:42.375486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:42.417854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615df63-499b-4123-b7e9-384af2158af5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:42.478456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 690/1401] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:08:42.525231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:42.525881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:42.526167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:42.526442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:42.528091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:42.535321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:42.611884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:42.613501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ecd112-2e4e-487c-bfeb-e06495e46eaa service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:42.621786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 712/1402] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:08:42.772111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:42.773615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:42.903934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c25dd-490a-4376-9f55-21be0c7e6c45 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:42.907637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:43.048757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:43.049282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:43.049557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:43.049872 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:43.051458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:43.155679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:43.157339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f9ca6-8eec-42ad-8baf-8ac4e3003aa7 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:43.177646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 691/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:45.163119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0cfb6-03b2-4333-b4d6-d6db8aecd5d6 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:45.163702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0cfb6-03b2-4333-b4d6-d6db8aecd5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:45.163702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0cfb6-03b2-4333-b4d6-d6db8aecd5d6 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:45.165181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 713/1404] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:45.170257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999e5d-94cf-43cb-863d-e979a49e13c8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:45.170720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999e5d-94cf-43cb-863d-e979a49e13c8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:45.170816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da999e5d-94cf-43cb-863d-e979a49e13c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:45.183493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:45.251804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-da999e5d-94cf-43cb-863d-e979a49e13c8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:45.253509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-da999e5d-94cf-43cb-863d-e979a49e13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:45.369391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 692/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:45.663532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0cfb6-03b2-4333-b4d6-d6db8aecd5d6 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:45.665097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f8c0cfb6-03b2-4333-b4d6-d6db8aecd5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:45.832862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0cfb6-03b2-4333-b4d6-d6db8aecd5d6 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:45.835732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:45.974891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:45.975695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:45.976103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:45.976446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:45.978281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:46.086164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:46.087896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6b357-24b2-4883-a045-7c339a85cc8b service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:46.107480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 714/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:48.074842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d31d7-87ec-45dc-a294-50d523cabdf2 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:48.075369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d31d7-87ec-45dc-a294-50d523cabdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:48.075503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7d31d7-87ec-45dc-a294-50d523cabdf2 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:48.076787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 693/1407] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:08:48.082954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb6ee4-14aa-4e5c-b44a-598a4fbcbcab None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:48.083810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb6ee4-14aa-4e5c-b44a-598a4fbcbcab None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:48.084089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb6ee4-14aa-4e5c-b44a-598a4fbcbcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:48.094067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:48.159988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-33cb6ee4-14aa-4e5c-b44a-598a4fbcbcab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:08:48.161223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-33cb6ee4-14aa-4e5c-b44a-598a4fbcbcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:48.271594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 715/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:08:48.565332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d31d7-87ec-45dc-a294-50d523cabdf2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:08:48.566297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5d7d31d7-87ec-45dc-a294-50d523cabdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:48.668931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:48.737961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7d31d7-87ec-45dc-a294-50d523cabdf2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:08:48.938565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:08:48.938565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:08:48.938565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:08:48.938565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:08:48.938930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:08:49.006036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:49.053772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:08:49.055464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0adea5-294e-49d7-b013-34634ea1f94d service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:08:49.080542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 694/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:08:58.269580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=62 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:08:59.077427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=23 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:05.088425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb7fa-e17c-4b5c-b8a9-7aa7a58376bf None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:05.088991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb7fa-e17c-4b5c-b8a9-7aa7a58376bf None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:05.088991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9fb7fa-e17c-4b5c-b8a9-7aa7a58376bf None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:05.090378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 716/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Aug 30 00:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:05.096180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae23b3-fc72-4b62-8f3e-447fd690ddc1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:05.096582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae23b3-fc72-4b62-8f3e-447fd690ddc1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:05.096765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae23b3-fc72-4b62-8f3e-447fd690ddc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:05.172781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0dae23b3-fc72-4b62-8f3e-447fd690ddc1 None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:05.173944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0dae23b3-fc72-4b62-8f3e-447fd690ddc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:05.280187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 695/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Aug 30 00:09:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:05.295558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b890-b327-4c7d-84a6-92fbfac92fd8 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:05.295929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b890-b327-4c7d-84a6-92fbfac92fd8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:05.296208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5b890-b327-4c7d-84a6-92fbfac92fd8 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:05.297554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 717/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Aug 30 00:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:05.302247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b03e9-97ea-4a3b-924f-d5ca24f8f7ba None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:05.302541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b03e9-97ea-4a3b-924f-d5ca24f8f7ba None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:05.302818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b03e9-97ea-4a3b-924f-d5ca24f8f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:05.375028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:05.378175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c21b03e9-97ea-4a3b-924f-d5ca24f8f7ba None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:05.379922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c21b03e9-97ea-4a3b-924f-d5ca24f8f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:05.495085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 696/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Aug 30 00:09:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:07.895961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc780b-493d-417c-b3fd-84072e84aea0 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:07.896489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc780b-493d-417c-b3fd-84072e84aea0 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:07.896489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc780b-493d-417c-b3fd-84072e84aea0 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:07.898137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:07.904760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e74f-3595-48c9-a8b1-4e84df21b06e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:07.904760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e74f-3595-48c9-a8b1-4e84df21b06e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:07.904760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b596e74f-3595-48c9-a8b1-4e84df21b06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:07.971041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b596e74f-3595-48c9-a8b1-4e84df21b06e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:07.972258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b596e74f-3595-48c9-a8b1-4e84df21b06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:08.028240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:08.069602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:08.354359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc780b-493d-417c-b3fd-84072e84aea0 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:08.355888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-99cc780b-493d-417c-b3fd-84072e84aea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:08.504839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc780b-493d-417c-b3fd-84072e84aea0 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:08.577424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:08.618419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:08.619029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:08.619312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:08.619591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:08.621195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:08.709385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:08.711012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24e70-fff8-4de8-9815-e1bc281d8fcf service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:08.729099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 719/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:09.631435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83092c47-0175-4af9-b28c-49fd87cbbf12 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:09.632006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83092c47-0175-4af9-b28c-49fd87cbbf12 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:09.632006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83092c47-0175-4af9-b28c-49fd87cbbf12 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:09.633348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:09.638196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfcd9-0847-4b1e-8c6f-a5c19af582a0 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:09.638644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfcd9-0847-4b1e-8c6f-a5c19af582a0 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:09.638742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfcd9-0847-4b1e-8c6f-a5c19af582a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:09.715338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2ddbfcd9-0847-4b1e-8c6f-a5c19af582a0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:09.716697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2ddbfcd9-0847-4b1e-8c6f-a5c19af582a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:09.743235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:09.813029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:09.964016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83092c47-0175-4af9-b28c-49fd87cbbf12 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:09.965543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-83092c47-0175-4af9-b28c-49fd87cbbf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:10.109334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83092c47-0175-4af9-b28c-49fd87cbbf12 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:10.149828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:10.224171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:10.224692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:10.224974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:10.225249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:10.226887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:10.314455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:10.316056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fefb0-cc72-4b7d-909b-9577d39afe2c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:10.333575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 699/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:11.219092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57166df4-9449-4eec-b855-3441e3ed3443 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:11.219604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57166df4-9449-4eec-b855-3441e3ed3443 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:11.219604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57166df4-9449-4eec-b855-3441e3ed3443 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:11.220918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:11.226077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebcf6-cc51-455c-a859-70a38af53129 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:11.226519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebcf6-cc51-455c-a859-70a38af53129 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:11.226622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ebcf6-cc51-455c-a859-70a38af53129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:11.288550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:11.311310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0a4ebcf6-cc51-455c-a859-70a38af53129 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:11.312507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0a4ebcf6-cc51-455c-a859-70a38af53129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:11.410534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:11.562683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57166df4-9449-4eec-b855-3441e3ed3443 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:11.564244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-57166df4-9449-4eec-b855-3441e3ed3443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:11.711512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57166df4-9449-4eec-b855-3441e3ed3443 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:11.724325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:11.826103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:11.826642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:11.826946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:11.827225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:11.828888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:11.919068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:11.920875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c453c74-3c15-47cc-8f3f-b595cbcd7ef6 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:11.940156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 722/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:12.808249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14258dd-5ee6-4cbf-8fa5-4909ade73b86 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:12.808781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14258dd-5ee6-4cbf-8fa5-4909ade73b86 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:12.808781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14258dd-5ee6-4cbf-8fa5-4909ade73b86 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:12.810268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:12.815450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b0d4-c60a-4c6d-aa38-e3794c293585 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:12.815838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b0d4-c60a-4c6d-aa38-e3794c293585 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:12.815998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b0d4-c60a-4c6d-aa38-e3794c293585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:12.836446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:12.892818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c758b0d4-c60a-4c6d-aa38-e3794c293585 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:12.894071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c758b0d4-c60a-4c6d-aa38-e3794c293585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:12.990347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:13.140265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14258dd-5ee6-4cbf-8fa5-4909ade73b86 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:13.141814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c14258dd-5ee6-4cbf-8fa5-4909ade73b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:13.252513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:13.290777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14258dd-5ee6-4cbf-8fa5-4909ade73b86 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:13.406524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:13.407095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:13.407387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:13.407678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:13.409288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:13.484480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:13.498618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:13.500225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db617-ce32-44d6-a460-042783a85774 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:13.519267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 702/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:14.390808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ce268-2cfa-4afe-88c0-bf783449725a None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:14.391389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ce268-2cfa-4afe-88c0-bf783449725a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:14.391389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ce268-2cfa-4afe-88c0-bf783449725a None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:14.392722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:14.397896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c9e9-3d97-4b8f-8965-624b003a0680 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:14.398334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c9e9-3d97-4b8f-8965-624b003a0680 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:14.398439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626c9e9-3d97-4b8f-8965-624b003a0680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:14.475403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b626c9e9-3d97-4b8f-8965-624b003a0680 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:14.476532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b626c9e9-3d97-4b8f-8965-624b003a0680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:14.576910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:09:14.728615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ce268-2cfa-4afe-88c0-bf783449725a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:14.730093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1c5ce268-2cfa-4afe-88c0-bf783449725a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:14.815531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:14.877896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ce268-2cfa-4afe-88c0-bf783449725a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:15.002894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:15.003422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:15.003704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:15.003974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:15.006048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:15.055582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:15.099979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:15.101577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe70a14-0434-4221-85c4-9200c0297db1 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:15.120291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 725/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:15.977763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d5d4-36ad-4dcf-8ef8-c4e7f258f9d5 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:15.978341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d5d4-36ad-4dcf-8ef8-c4e7f258f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:15.978341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462d5d4-36ad-4dcf-8ef8-c4e7f258f9d5 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:15.979647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:15.985304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d949a5-228f-4813-aebf-bcc0bcf52451 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:15.985786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d949a5-228f-4813-aebf-bcc0bcf52451 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:15.985895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d949a5-228f-4813-aebf-bcc0bcf52451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:16.061830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c9d949a5-228f-4813-aebf-bcc0bcf52451 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:16.063053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c9d949a5-228f-4813-aebf-bcc0bcf52451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:16.159740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:16.311216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d5d4-36ad-4dcf-8ef8-c4e7f258f9d5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:16.312656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d462d5d4-36ad-4dcf-8ef8-c4e7f258f9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:16.360516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:16.458032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462d5d4-36ad-4dcf-8ef8-c4e7f258f9d5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:16.570734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:16.571256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:16.571536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:16.571806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:16.573400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:16.581337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:16.665778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:16.667369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d2a3a-1c69-4cbc-a68f-e7389c82abc3 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:16.685870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 705/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:17.497760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa602f-8ad3-4e61-8870-54f85662f381 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:17.498296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa602f-8ad3-4e61-8870-54f85662f381 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:17.498296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa602f-8ad3-4e61-8870-54f85662f381 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:17.499692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:17.504554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86041-2abc-46de-8721-a5f3b41c5a60 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:17.504952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86041-2abc-46de-8721-a5f3b41c5a60 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:17.505118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f86041-2abc-46de-8721-a5f3b41c5a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:17.580534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b4f86041-2abc-46de-8721-a5f3b41c5a60 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:17.581689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b4f86041-2abc-46de-8721-a5f3b41c5a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:17.649626 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:17.679458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:17.829074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa602f-8ad3-4e61-8870-54f85662f381 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:17.830759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-85fa602f-8ad3-4e61-8870-54f85662f381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:17.848947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:17.982870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa602f-8ad3-4e61-8870-54f85662f381 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:18.071344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:18.097908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:18.098436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:18.098718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:18.098991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:18.100587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:18.203947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:18.205663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f91cab-ebb2-4e7a-b66e-012008897b46 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:18.225484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 728/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:19.071119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83d4b-e4ae-4688-b8af-f4aac75f2813 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:19.071677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83d4b-e4ae-4688-b8af-f4aac75f2813 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:19.071785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c83d4b-e4ae-4688-b8af-f4aac75f2813 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:19.073044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:19.078480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecffe7b-5395-4d13-a785-abeed0abee59 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:19.078931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecffe7b-5395-4d13-a785-abeed0abee59 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:19.079039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecffe7b-5395-4d13-a785-abeed0abee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:19.156308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2ecffe7b-5395-4d13-a785-abeed0abee59 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:19.157531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2ecffe7b-5395-4d13-a785-abeed0abee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:19.200604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:19.257365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:19.408735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c83d4b-e4ae-4688-b8af-f4aac75f2813 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:19.410340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-01c83d4b-e4ae-4688-b8af-f4aac75f2813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:19.566942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c83d4b-e4ae-4688-b8af-f4aac75f2813 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:19.623396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:19.682351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:19.682952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:19.683232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:19.683506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:19.686109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:19.780068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:19.781676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83069a94-5250-4488-8f60-89713e42e373 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:19.799740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 708/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:20.607102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af225c55-dbe4-4420-9e7b-21e0ab6bed5f None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:20.607649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af225c55-dbe4-4420-9e7b-21e0ab6bed5f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:20.607649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af225c55-dbe4-4420-9e7b-21e0ab6bed5f None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:20.608976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:09:20.614010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef71d7-6d86-4f9c-b231-d631920fd007 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:20.614431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef71d7-6d86-4f9c-b231-d631920fd007 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:20.614565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef71d7-6d86-4f9c-b231-d631920fd007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:20.693201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-25ef71d7-6d86-4f9c-b231-d631920fd007 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:20.694468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-25ef71d7-6d86-4f9c-b231-d631920fd007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:20.696474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:20.790581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:09:20.947446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af225c55-dbe4-4420-9e7b-21e0ab6bed5f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:20.948998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-af225c55-dbe4-4420-9e7b-21e0ab6bed5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:21.096618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af225c55-dbe4-4420-9e7b-21e0ab6bed5f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:21.125490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:21.212750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:21.213281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:21.213566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:21.213878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:21.216234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:21.306126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:21.308110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906164e-888d-4abc-85e7-816644f27c80 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:21.326998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 731/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:23.271014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c305fb-5604-4ed2-a89c-69121d73080d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:23.271881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c305fb-5604-4ed2-a89c-69121d73080d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:23.271881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c305fb-5604-4ed2-a89c-69121d73080d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:23.273105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:23.280197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655c768-1873-46f4-96b7-f8008a5d1071 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:23.280655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655c768-1873-46f4-96b7-f8008a5d1071 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:23.280768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655c768-1873-46f4-96b7-f8008a5d1071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:23.326034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:23.352318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c655c768-1873-46f4-96b7-f8008a5d1071 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:23.353537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c655c768-1873-46f4-96b7-f8008a5d1071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:23.465815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:23.762990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c305fb-5604-4ed2-a89c-69121d73080d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:23.764520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-63c305fb-5604-4ed2-a89c-69121d73080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:23.883175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c305fb-5604-4ed2-a89c-69121d73080d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:23.918881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:23.960043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:23.960648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:23.960937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:23.961217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:23.962850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:24.069017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:24.070413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2914e-acdf-43a9-8122-e5e7bbf1a546 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:24.090502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 711/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:26.158121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fcca1-f24b-41e8-8ed3-eb54870b27ac None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:26.158676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fcca1-f24b-41e8-8ed3-eb54870b27ac None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:26.158676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94fcca1-f24b-41e8-8ed3-eb54870b27ac None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:26.160014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:26.165255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0a456-1daa-4a4b-8655-51bbb9ee3b9d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:26.165664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0a456-1daa-4a4b-8655-51bbb9ee3b9d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:26.165839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0a456-1daa-4a4b-8655-51bbb9ee3b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:26.233558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-34c0a456-1daa-4a4b-8655-51bbb9ee3b9d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:26.234791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-34c0a456-1daa-4a4b-8655-51bbb9ee3b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:26.248365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:26.334490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:26.623252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fcca1-f24b-41e8-8ed3-eb54870b27ac None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:26.624869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c94fcca1-f24b-41e8-8ed3-eb54870b27ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:26.728498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94fcca1-f24b-41e8-8ed3-eb54870b27ac None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:26.741078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:26.804101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:26.804707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:26.804992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:26.805286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:26.806926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:26.916790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:26.918316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b12324-2cd4-4504-8619-a7801fc247a4 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:26.937042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 734/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:29.231412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5d560-ee38-44c6-8706-7d82b8119f64 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:29.231951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5d560-ee38-44c6-8706-7d82b8119f64 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:29.231951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d5d560-ee38-44c6-8706-7d82b8119f64 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:29.233227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:09:29.238563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e74ecf-875f-4ca5-824a-18bca31e775a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:29.238992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e74ecf-875f-4ca5-824a-18bca31e775a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:29.239108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e74ecf-875f-4ca5-824a-18bca31e775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:29.288560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:29.308670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-65e74ecf-875f-4ca5-824a-18bca31e775a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:29.310011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-65e74ecf-875f-4ca5-824a-18bca31e775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:29.418854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:29.704767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5d560-ee38-44c6-8706-7d82b8119f64 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:29.706393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a9d5d560-ee38-44c6-8706-7d82b8119f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:29.810018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d5d560-ee38-44c6-8706-7d82b8119f64 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:29.850694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:29.885128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:29.886418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:29.886676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:29.886928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:29.888538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:29.998328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:29.999708 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70470da-8664-42f9-9296-e56c4cf893f5 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:30.018231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 714/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:32.046213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad048-1ebd-41e5-bf38-5a934b19c8a6 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:32.046769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad048-1ebd-41e5-bf38-5a934b19c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:32.046769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bad048-1ebd-41e5-bf38-5a934b19c8a6 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:32.048114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:32.053370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d035e1-d6dd-4292-9a03-498ab3a05cdf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:32.053980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d035e1-d6dd-4292-9a03-498ab3a05cdf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:32.053980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d035e1-d6dd-4292-9a03-498ab3a05cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:32.120922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-30d035e1-d6dd-4292-9a03-498ab3a05cdf None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:32.122144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-30d035e1-d6dd-4292-9a03-498ab3a05cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:32.142460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:32.219323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:32.519588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad048-1ebd-41e5-bf38-5a934b19c8a6 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:32.521380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-48bad048-1ebd-41e5-bf38-5a934b19c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:32.635677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bad048-1ebd-41e5-bf38-5a934b19c8a6 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:32.657347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:32.713239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:32.714868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:32.715155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:32.715436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:32.717037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:32.840562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:32.842368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25953738-8a08-4480-a851-0ccbdd129a2d service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:32.864877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 737/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:34.928346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf2ad-4ec7-469f-b788-be199fe8ad60 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:34.928814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf2ad-4ec7-469f-b788-be199fe8ad60 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:34.928936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34baf2ad-4ec7-469f-b788-be199fe8ad60 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:34.930275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:34.936918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670736-beb5-41b2-bdea-8907df508f0a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:34.937341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670736-beb5-41b2-bdea-8907df508f0a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:34.937476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29670736-beb5-41b2-bdea-8907df508f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.000689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:35.003679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-29670736-beb5-41b2-bdea-8907df508f0a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:35.004892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-29670736-beb5-41b2-bdea-8907df508f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:35.103488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:09:35.384702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf2ad-4ec7-469f-b788-be199fe8ad60 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:35.386268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-34baf2ad-4ec7-469f-b788-be199fe8ad60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:35.497271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34baf2ad-4ec7-469f-b788-be199fe8ad60 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:35.546434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:35.571530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:35.572125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:35.572407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:35.573372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:35.575077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:35.685470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:35.686892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38b71f-9a5d-4442-bde9-1cc9257e3c85 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:35.705449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 717/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:37.693385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009f6e-1904-4b10-b0d4-536c3d2aa8df None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:37.693953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009f6e-1904-4b10-b0d4-536c3d2aa8df None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:37.693953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb009f6e-1904-4b10-b0d4-536c3d2aa8df None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:37.695355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:37.701112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8f80b-6377-4b1b-845a-e0ca872b865c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:37.701563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8f80b-6377-4b1b-845a-e0ca872b865c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:37.701666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8f80b-6377-4b1b-845a-e0ca872b865c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:37.768702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d5a8f80b-6377-4b1b-845a-e0ca872b865c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:37.769927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5a8f80b-6377-4b1b-845a-e0ca872b865c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:37.800261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:37.870017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:38.159237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009f6e-1904-4b10-b0d4-536c3d2aa8df None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:38.160784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fb009f6e-1904-4b10-b0d4-536c3d2aa8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:38.264429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb009f6e-1904-4b10-b0d4-536c3d2aa8df None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:38.292724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:38.339886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:38.340528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:38.340814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:38.341091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:38.342745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:38.452155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:38.453590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c3e40-44d5-426d-bd0e-53bdb3aff981 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:38.471341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 740/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:40.445351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b452-a97c-4115-8420-b29fb01f610e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:40.445862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b452-a97c-4115-8420-b29fb01f610e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:40.445954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1802b452-a97c-4115-8420-b29fb01f610e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:40.447354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:40.452713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520622e-88ea-4d98-a7b4-c6cf53ee68b5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:40.453171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520622e-88ea-4d98-a7b4-c6cf53ee68b5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:40.453269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6520622e-88ea-4d98-a7b4-c6cf53ee68b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:40.519836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6520622e-88ea-4d98-a7b4-c6cf53ee68b5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:40.521335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6520622e-88ea-4d98-a7b4-c6cf53ee68b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:40.530160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:40.618622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:40.904973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b452-a97c-4115-8420-b29fb01f610e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:40.906581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1802b452-a97c-4115-8420-b29fb01f610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:41.011181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1802b452-a97c-4115-8420-b29fb01f610e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:41.065905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:41.084580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:41.085184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:41.085468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:41.085767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:41.087383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:41.193365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:41.194735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4483cb-009c-423f-9366-f0026fc8d04c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:41.212884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 720/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:43.190536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639944-009e-4b16-af0a-be94c99a1754 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.191062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639944-009e-4b16-af0a-be94c99a1754 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.191062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a639944-009e-4b16-af0a-be94c99a1754 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.192337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:43.198114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a75915-981a-4c8b-8198-2e1a2e1b6789 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.198535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a75915-981a-4c8b-8198-2e1a2e1b6789 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.198638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a75915-981a-4c8b-8198-2e1a2e1b6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.265016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-78a75915-981a-4c8b-8198-2e1a2e1b6789 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:43.266264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-78a75915-981a-4c8b-8198-2e1a2e1b6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.304849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:43.364158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:43.661920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639944-009e-4b16-af0a-be94c99a1754 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:43.663445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7a639944-009e-4b16-af0a-be94c99a1754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.769603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a639944-009e-4b16-af0a-be94c99a1754 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:43.807330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:43.841606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:43.842228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:43.842506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:43.842776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:43.844357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:43.952217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:43.953644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489b07e1-2a6a-4993-9c6e-b86b40079e43 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:43.971825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 743/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:45.923504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990b6d-21a1-45d0-8db2-b367f11965aa None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:45.923923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990b6d-21a1-45d0-8db2-b367f11965aa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:45.924058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c990b6d-21a1-45d0-8db2-b367f11965aa None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:45.925450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:45.930659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed682-5017-45c5-8b70-93512c457226 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:45.931079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed682-5017-45c5-8b70-93512c457226 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:45.931247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338ed682-5017-45c5-8b70-93512c457226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:45.997780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-338ed682-5017-45c5-8b70-93512c457226 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:45.998987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-338ed682-5017-45c5-8b70-93512c457226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:46.017326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:46.098064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:46.383160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990b6d-21a1-45d0-8db2-b367f11965aa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:46.385419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2c990b6d-21a1-45d0-8db2-b367f11965aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:46.489362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c990b6d-21a1-45d0-8db2-b367f11965aa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:46.557964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:46.565128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:46.565787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:46.566075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:46.566351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:46.568014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:46.676397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:46.677970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d310340-fba7-401f-a3e1-3dec55d731e0 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:46.696691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 723/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:48.626987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e035dc-5e9d-4af5-aff0-8aba864b002c None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:48.627580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e035dc-5e9d-4af5-aff0-8aba864b002c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:48.627580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e035dc-5e9d-4af5-aff0-8aba864b002c None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:48.628915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:09:48.634965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712e9dc-cd79-4eeb-a3d5-9132eb335fab None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:48.635483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712e9dc-cd79-4eeb-a3d5-9132eb335fab None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:48.635595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712e9dc-cd79-4eeb-a3d5-9132eb335fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:48.702566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d712e9dc-cd79-4eeb-a3d5-9132eb335fab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:09:48.703683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d712e9dc-cd79-4eeb-a3d5-9132eb335fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:48.753118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:48.802231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:09:49.085369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e035dc-5e9d-4af5-aff0-8aba864b002c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:09:49.087031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a2e035dc-5e9d-4af5-aff0-8aba864b002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:49.191165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e035dc-5e9d-4af5-aff0-8aba864b002c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:09:49.239548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:49.267510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:09:49.268120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:09:49.268400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:09:49.268672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:09:49.270540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:09:49.381729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:09:49.383227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183dcdb-e7af-4e00-8c49-1e3a36289d21 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:09:49.402034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 746/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:09:58.800301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=22 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:09:59.399731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=66 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:09.085363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2cde3-df94-41fe-8aef-54c2c7375c5d None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:09.085953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2cde3-df94-41fe-8aef-54c2c7375c5d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:09.086111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e2cde3-df94-41fe-8aef-54c2c7375c5d None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:09.087476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 725/1471] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:09.092601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cade8-03f7-4d88-b8a1-84394fad9256 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:09.093013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cade8-03f7-4d88-b8a1-84394fad9256 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:09.093161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685cade8-03f7-4d88-b8a1-84394fad9256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:09.159473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-685cade8-03f7-4d88-b8a1-84394fad9256 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:09.160672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-685cade8-03f7-4d88-b8a1-84394fad9256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:09.259874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 747/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:09.563440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef643-3993-466e-a5fe-a3245e4f41fa None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:09.563731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef643-3993-466e-a5fe-a3245e4f41fa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:09.564008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ef643-3993-466e-a5fe-a3245e4f41fa None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:09.565350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 726/1473] 10.222.0.43 () {54 vars in 967 bytes} [Tue Aug 30 00:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:09.570421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9deabb-1c57-46c8-9874-682859cdbf95 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:09.570736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9deabb-1c57-46c8-9874-682859cdbf95 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:09.571000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9deabb-1c57-46c8-9874-682859cdbf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:09.647157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6b9deabb-1c57-46c8-9874-682859cdbf95 None None] MFA Rules not processed for user `274f72b3a3c34d6388ff820627f2f4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:09.648900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6b9deabb-1c57-46c8-9874-682859cdbf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:09.670031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:09.728280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 748/1474] 10.222.0.43 () {58 vars in 1064 bytes} [Tue Aug 30 00:10:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:09.735754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef643-3993-466e-a5fe-a3245e4f41fa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:09.737248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-774ef643-3993-466e-a5fe-a3245e4f41fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:09.839321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ef643-3993-466e-a5fe-a3245e4f41fa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:09.913859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:09.914893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:09.914893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:09.915172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:09.918828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:09.978215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:10.038000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:10.039474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b586262-ff7c-4eb5-b818-675540290bf3 service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:10.063826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 727/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:12.096038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e8e6-175d-4693-9f1d-fc850aa55241 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:12.096605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e8e6-175d-4693-9f1d-fc850aa55241 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:12.096721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4535e8e6-175d-4693-9f1d-fc850aa55241 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:12.098159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 749/1476] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:12.104511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e7746-c650-418f-8543-d2bdfaee4a40 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:12.104958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e7746-c650-418f-8543-d2bdfaee4a40 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:12.105053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e7746-c650-418f-8543-d2bdfaee4a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:12.171462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e96e7746-c650-418f-8543-d2bdfaee4a40 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:12.172610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e96e7746-c650-418f-8543-d2bdfaee4a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:12.270089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 728/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:12.547516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e8e6-175d-4693-9f1d-fc850aa55241 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:12.549052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4535e8e6-175d-4693-9f1d-fc850aa55241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:12.680804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4535e8e6-175d-4693-9f1d-fc850aa55241 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:12.730297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:12.775047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:12.775651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:12.775934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:12.776206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:12.776841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:12.778660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:10:12.778660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:10:12.778660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:10:12.779811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5f587-9cb4-4824-b006-51643a3511d5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:12.799226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 750/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Aug 30 00:10:12 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:10:14.914973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04d0c-8636-40d3-b5c4-e6b9fb460885 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:14.915498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04d0c-8636-40d3-b5c4-e6b9fb460885 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:14.915628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04d0c-8636-40d3-b5c4-e6b9fb460885 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:14.917914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 729/1479] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:10:14.922926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac196db-4f76-476e-a5fe-f0d08213073b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:14.923426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac196db-4f76-476e-a5fe-f0d08213073b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:14.923538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac196db-4f76-476e-a5fe-f0d08213073b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:15.000653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-dac196db-4f76-476e-a5fe-f0d08213073b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:15.001916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dac196db-4f76-476e-a5fe-f0d08213073b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:15.109356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 751/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:15.406489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e04d0c-8636-40d3-b5c4-e6b9fb460885 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:15.408662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-93e04d0c-8636-40d3-b5c4-e6b9fb460885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:15.420989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:15.567457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e04d0c-8636-40d3-b5c4-e6b9fb460885 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:15.656166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:15.698399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:15.699006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:15.699283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:15.699558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:15.701342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:15.795520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:15.797114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e54a6-8222-49ea-85d9-eba0d9b7f50c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:15.815197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 730/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:17.947341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67640754-26c1-4460-95c0-baf8f8d84008 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:17.947873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67640754-26c1-4460-95c0-baf8f8d84008 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:17.947873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67640754-26c1-4460-95c0-baf8f8d84008 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:17.949275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 752/1482] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:17.954912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1140-6754-4308-adf4-9b8aa8020a75 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:17.955349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1140-6754-4308-adf4-9b8aa8020a75 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:17.955452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1140-6754-4308-adf4-9b8aa8020a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:18.024764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5f8e1140-6754-4308-adf4-9b8aa8020a75 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:18.026001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5f8e1140-6754-4308-adf4-9b8aa8020a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:18.073962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:18.126180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 731/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:18.416900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67640754-26c1-4460-95c0-baf8f8d84008 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:18.418477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-67640754-26c1-4460-95c0-baf8f8d84008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:18.443592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:18.522934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67640754-26c1-4460-95c0-baf8f8d84008 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:18.595696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:18.596657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:18.596943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:18.597210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:18.598857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:18.674546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:18.710258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:18.711713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317cfe6d-e764-45b7-86c4-4326fc4a0c05 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:18.730302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 753/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:20.905248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb0e8-fbb0-4412-83c1-2dc0ebe699bd None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:20.905857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb0e8-fbb0-4412-83c1-2dc0ebe699bd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:20.905857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fb0e8-fbb0-4412-83c1-2dc0ebe699bd None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:20.907199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 732/1485] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:20.913242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499c2d-9ad1-46fa-9ce4-68842406d7ed None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:20.913870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499c2d-9ad1-46fa-9ce4-68842406d7ed None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:20.913870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3499c2d-9ad1-46fa-9ce4-68842406d7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:20.980876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d3499c2d-9ad1-46fa-9ce4-68842406d7ed None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:20.982156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d3499c2d-9ad1-46fa-9ce4-68842406d7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:21.081561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 754/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:21.369669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb0e8-fbb0-4412-83c1-2dc0ebe699bd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:21.371298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f55fb0e8-fbb0-4412-83c1-2dc0ebe699bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:21.475862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fb0e8-fbb0-4412-83c1-2dc0ebe699bd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:21.548167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:21.550013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:21.550624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:21.551144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:21.551717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:21.553557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:21.664234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:21.665627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ff766b-36ed-4fbd-8a2e-58c62c6b73e5 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:21.683928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 733/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:23.794059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03764a-8399-4cd9-a9cc-8f891a0ad14e None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:23.794631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03764a-8399-4cd9-a9cc-8f891a0ad14e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:23.794631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03764a-8399-4cd9-a9cc-8f891a0ad14e None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:23.795970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 755/1488] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:23.801163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246893a-5e45-4764-ad01-550d0680f237 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:23.801647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246893a-5e45-4764-ad01-550d0680f237 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:23.801777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246893a-5e45-4764-ad01-550d0680f237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:23.869574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8246893a-5e45-4764-ad01-550d0680f237 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:23.870849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8246893a-5e45-4764-ad01-550d0680f237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:23.924965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:23.971759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 734/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:24.272701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03764a-8399-4cd9-a9cc-8f891a0ad14e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:24.274321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5b03764a-8399-4cd9-a9cc-8f891a0ad14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:24.312256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:24.380983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03764a-8399-4cd9-a9cc-8f891a0ad14e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:24.465343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:24.466089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:24.466379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:24.466658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:24.468274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:24.562485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:24.592662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:24.594154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5009e9-c8d0-4dd4-b7f6-8e173b30bde7 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:24.612082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 756/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:26.712219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2e7c-36c3-4f31-bb33-2e4b0819e320 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:26.712747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2e7c-36c3-4f31-bb33-2e4b0819e320 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:26.712747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e2e7c-36c3-4f31-bb33-2e4b0819e320 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:26.714054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 735/1491] 10.222.0.43 () {54 vars in 927 bytes} [Tue Aug 30 00:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:10:26.719184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85cad-0c65-4cb2-8818-3ffc24a6b9ea None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:26.719579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85cad-0c65-4cb2-8818-3ffc24a6b9ea None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:26.719744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a85cad-0c65-4cb2-8818-3ffc24a6b9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:26.786017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d6a85cad-0c65-4cb2-8818-3ffc24a6b9ea None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:10:26.787420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d6a85cad-0c65-4cb2-8818-3ffc24a6b9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:26.885411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 757/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Tue Aug 30 00:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:10:27.175615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2e7c-36c3-4f31-bb33-2e4b0819e320 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:10:27.177579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7f2e2e7c-36c3-4f31-bb33-2e4b0819e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:27.296329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e2e7c-36c3-4f31-bb33-2e4b0819e320 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:10:27.377360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:10:27.378025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:10:27.378301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:10:27.378570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:10:27.380228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:10:27.389593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:27.492914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:10:27.494341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a3d5e-66b6-4521-a286-98428bdd8aff service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:10:27.511898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 736/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:10:36.883605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=82 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:10:37.509772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=50 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:41.802276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:41.802878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:41.802878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:41.879641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:11:41.880826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:41.979470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 758/1494] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:11:41.987755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:41.988262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:41.988366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:42.185044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:11:42.186295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:42.282353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 737/1495] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:11:42.287075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:42.288283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:42.300229 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15528f08-125b-4abe-9119-7a1cb7f372bf None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:42.360885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:42.397181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:42.397819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:42.398106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:42.398373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:42.399019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:11:42.399320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:42.400315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:42.400315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:11:42.400315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:11:42.401232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:42.412335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 759/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:11:42.420800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:42.430512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76544db4-b3e9-4d77-89d9-7f52303f9ccd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:42.491464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:42.525428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:42.526064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:42.526351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:42.526630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:42.527258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:42.528989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:42.528989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:11:42.528989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:11:42.530215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:42.585095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 738/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:11:42 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:11:42.589262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:42.590894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:42.624436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5aeb6-7688-47f5-94cd-5df2682d3409 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:42.719480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:42.720130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:42.720410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:42.720680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:42.721309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:42.722341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:42.722341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:11:42.722341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:11:42.723897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:42.767826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 760/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:11:42 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:11:42.772075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:42.773668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:42.836564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdeff0-3b1b-417e-a73f-6f4b3a9d1a1a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:42.920458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:42.932495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:42.933097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:42.933376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:42.933646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:42.934316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:42.935324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:42.935324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:11:42.935324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:11:42.936203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:42.950635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 739/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:11:42.954716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:42.956237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:42.969227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac33c82-0622-4134-ad4f-09cb251d5513 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:42.994281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:43.064845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:43.065364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.065645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.065943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.067250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:43.068218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:43.068218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:11:43.068218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:11:43.069103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d5fe8-c7a9-4dd8-9211-b93240788c28 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:43.081409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 761/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:11:43.086284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:43.087812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:43.120564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087ba57-6a9a-47fe-8464-31fc29e6c4a3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:43.214888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:43.215532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.215807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.216156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] PATH_INFO: `/v3/projects/dfa9523d68004096bfb6a8260c0cb862/users/578b7951284d45ae9dfcaf51f539cd33/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.240161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfa9523d68004096bfb6a8260c0cb862, user_id=578b7951284d45ae9dfcaf51f539cd33, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:43.241177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:43.241177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:11:43.241177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:11:43.243141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4328d-7e6f-4a0a-b869-677e280b8409 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:43.268250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 740/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:11:43 2022] PUT /identity/v3/projects/dfa9523d68004096bfb6a8260c0cb862/users/578b7951284d45ae9dfcaf51f539cd33/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:11:43.281280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d091d3-6171-4216-b4ba-634f2a01018a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.281569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d091d3-6171-4216-b4ba-634f2a01018a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.281881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d091d3-6171-4216-b4ba-634f2a01018a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.339390 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-a1d091d3-6171-4216-b4ba-634f2a01018a None None] MFA Rules not processed for user `578b7951284d45ae9dfcaf51f539cd33`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:11:43.340507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a1d091d3-6171-4216-b4ba-634f2a01018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:43.418496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 762/1502] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:11:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:11:43.431908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748214c-fc8a-4351-b046-b10de6e6e8cf None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.432201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748214c-fc8a-4351-b046-b10de6e6e8cf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.432478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9748214c-fc8a-4351-b046-b10de6e6e8cf None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.434006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 741/1503] 10.222.0.43 () {54 vars in 964 bytes} [Tue Aug 30 00:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:11:43.438870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4ae19-1295-489b-a22b-18134ab2d1ea None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.439165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4ae19-1295-489b-a22b-18134ab2d1ea None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.439449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4ae19-1295-489b-a22b-18134ab2d1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.470976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:43.515546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c7d4ae19-1295-489b-a22b-18134ab2d1ea None None] MFA Rules not processed for user `0f458d5fcb964638be06e1bf21869250`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:11:43.517000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c7d4ae19-1295-489b-a22b-18134ab2d1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:43.592241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 763/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Aug 30 00:11:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:11:43.599975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748214c-fc8a-4351-b046-b10de6e6e8cf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:43.601506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9748214c-fc8a-4351-b046-b10de6e6e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:43.651780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:43.706266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9748214c-fc8a-4351-b046-b10de6e6e8cf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:43.778650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:43.779245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.779520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.779787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.781370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:43.877545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:43.879012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:43.883273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:43.898927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 742/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:11:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:11:43.944539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6deb-e978-473b-8cf9-151278a61038 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:43.944823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6deb-e978-473b-8cf9-151278a61038 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:43.945098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd6deb-e978-473b-8cf9-151278a61038 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:43.946405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 764/1506] 10.222.0.43 () {52 vars in 830 bytes} [Tue Aug 30 00:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:11:43.949880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:43.951096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:44.048520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a3e6e-3a50-44b9-94a0-f0d810ae793d service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:44.141219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:44.142142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:44.142358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:44.142632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] PATH_INFO: `/v3/users/578b7951284d45ae9dfcaf51f539cd33` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:44.154992 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=578b7951284d45ae9dfcaf51f539cd33)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:44.156009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:44.156009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:11:44.156009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:11:44.157233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:44.166826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:44.225276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578b7951284d45ae9dfcaf51f539cd33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:44.239997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578b7951284d45ae9dfcaf51f539cd33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:44.240575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578b7951284d45ae9dfcaf51f539cd33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:44.250146 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578b7951284d45ae9dfcaf51f539cd33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:44.250577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578b7951284d45ae9dfcaf51f539cd33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:44.279012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 743/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:11:43 2022] DELETE /identity/v3/users/578b7951284d45ae9dfcaf51f539cd33 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:11:44.283340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:44.283795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:44.283901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:44.341071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:11:44.342307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:44.419371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:44.433850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 765/1508] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:11:44.443590 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:44.444892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:44.545905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b75e0b-4793-49bc-aa04-a919641b7b4a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:44.602732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:44.623098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:44.623712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:44.623990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:44.624263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:44.625898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:44.736586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:44.738001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b9112-0e59-489b-ab07-19898880dd94 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:44.757304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 744/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:11:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:11:45.105887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:11:45.107154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:11:45.118965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c44b79-b25c-40ed-982a-2d5a8d584051 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:11:45.224768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:11:45.225397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:11:45.225672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:11:45.225970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] PATH_INFO: `/v3/projects/dfa9523d68004096bfb6a8260c0cb862` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:11:45.235772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfa9523d68004096bfb6a8260c0cb862)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:11:45.236788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:11:45.236788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:11:45.236788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:11:45.238005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:11:45.416569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfa9523d68004096bfb6a8260c0cb862', 'request_id': 'req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:45.426370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfa9523d68004096bfb6a8260c0cb862', 'request_id': 'req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:45.441123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfa9523d68004096bfb6a8260c0cb862', 'request_id': 'req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:45.463930 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] The token cache is being invalidate because project dfa9523d68004096bfb6a8260c0cb862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:11:45.464224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:45.464750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-94f7d47e-89ed-41e6-bf61-0a7bcfed2faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:11:45.466109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 766/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:11:45 2022] DELETE /identity/v3/projects/dfa9523d68004096bfb6a8260c0cb862 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:11:54.755173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=62 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:11:55.461977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:21.167438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098dcac-ddd7-4468-bc54-4a93f41e15a7 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:21.168078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098dcac-ddd7-4468-bc54-4a93f41e15a7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:21.168078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098dcac-ddd7-4468-bc54-4a93f41e15a7 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:21.169483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:21.174570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d5712-bff5-4295-98d3-d0b364f5e602 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:21.175044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d5712-bff5-4295-98d3-d0b364f5e602 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:21.175147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d5712-bff5-4295-98d3-d0b364f5e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:21.257064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-084d5712-bff5-4295-98d3-d0b364f5e602 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:21.258342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-084d5712-bff5-4295-98d3-d0b364f5e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:21.362169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:13:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:21.518226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098dcac-ddd7-4468-bc54-4a93f41e15a7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:21.521152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a098dcac-ddd7-4468-bc54-4a93f41e15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:21.639879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098dcac-ddd7-4468-bc54-4a93f41e15a7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:21.646632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a30569-3e18-4bbb-b8d3-0c2d7857b2a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:21.647237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30569-3e18-4bbb-b8d3-0c2d7857b2a3 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:21.647521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30569-3e18-4bbb-b8d3-0c2d7857b2a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:21.647796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a30569-3e18-4bbb-b8d3-0c2d7857b2a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:21.656769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a30569-3e18-4bbb-b8d3-0c2d7857b2a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:21.658397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a30569-3e18-4bbb-b8d3-0c2d7857b2a3 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:21.667885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 746/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:22.519133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74943-286a-47a6-ab96-4444ac224ca6 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:22.519710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74943-286a-47a6-ab96-4444ac224ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:22.519859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a74943-286a-47a6-ab96-4444ac224ca6 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:22.521252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 768/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:22.526211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee96bd-c86b-4a1c-9f95-2d01d26f6e1e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:22.526634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee96bd-c86b-4a1c-9f95-2d01d26f6e1e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:22.526986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee96bd-c86b-4a1c-9f95-2d01d26f6e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:22.546532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-26ee96bd-c86b-4a1c-9f95-2d01d26f6e1e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:22.547983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-26ee96bd-c86b-4a1c-9f95-2d01d26f6e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:22.556937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 747/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:22.709129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74943-286a-47a6-ab96-4444ac224ca6 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:22.723780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a74943-286a-47a6-ab96-4444ac224ca6 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:22.729155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf92be-2c0a-48b5-9131-83b163d9be88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:22.729770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf92be-2c0a-48b5-9131-83b163d9be88 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:22.730057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf92be-2c0a-48b5-9131-83b163d9be88 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:22.730332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf92be-2c0a-48b5-9131-83b163d9be88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:22.739268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf92be-2c0a-48b5-9131-83b163d9be88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:22.740835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf92be-2c0a-48b5-9131-83b163d9be88 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:22.750150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 769/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:23.649869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1d89-1289-494b-9ce6-6e00be752b75 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:23.650436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1d89-1289-494b-9ce6-6e00be752b75 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:23.650436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e1d89-1289-494b-9ce6-6e00be752b75 None None] PATH_INFO: `/v3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:23.651726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 748/1517] 10.222.0.49 () {54 vars in 925 bytes} [Tue Aug 30 00:13:23 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:13:23.658031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885aa9c-1d55-4f2f-ae4b-7b2da190acf3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:23.658425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885aa9c-1d55-4f2f-ae4b-7b2da190acf3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:23.658625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885aa9c-1d55-4f2f-ae4b-7b2da190acf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:23.717402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5885aa9c-1d55-4f2f-ae4b-7b2da190acf3 None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:23.718648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5885aa9c-1d55-4f2f-ae4b-7b2da190acf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:23.736147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:23.792348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 770/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 30 00:13:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:27.686933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7354-bd41-4031-b524-0b498854d2d4 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:27.687451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7354-bd41-4031-b524-0b498854d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:27.687451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f7354-bd41-4031-b524-0b498854d2d4 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:27.688734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 749/1519] 10.222.0.43 () {54 vars in 961 bytes} [Tue Aug 30 00:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:27.693826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b1810-5c7d-485b-a262-8ec11bebb5db None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:27.694230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b1810-5c7d-485b-a262-8ec11bebb5db None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:27.694412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b1810-5c7d-485b-a262-8ec11bebb5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:27.714222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ce6b1810-5c7d-485b-a262-8ec11bebb5db None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:27.715264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ce6b1810-5c7d-485b-a262-8ec11bebb5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:27.724375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 771/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Aug 30 00:13:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:27.731855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7354-bd41-4031-b524-0b498854d2d4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:27.745315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f7354-bd41-4031-b524-0b498854d2d4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:27.750381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182ade2f-ceee-43ed-a740-f975d342491a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:27.750984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ade2f-ceee-43ed-a740-f975d342491a service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:27.751269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ade2f-ceee-43ed-a740-f975d342491a service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:27.751544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ade2f-ceee-43ed-a740-f975d342491a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:27.759918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ade2f-ceee-43ed-a740-f975d342491a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:27.761508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182ade2f-ceee-43ed-a740-f975d342491a service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:27.771802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 750/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:33.953353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616c26-0b7e-491d-823b-202373590033 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:33.953828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616c26-0b7e-491d-823b-202373590033 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:33.953942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616c26-0b7e-491d-823b-202373590033 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:33.955256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:33.960602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f399-cbe2-4738-8bc7-bb87770df140 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:33.961042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f399-cbe2-4738-8bc7-bb87770df140 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:33.961145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca0f399-cbe2-4738-8bc7-bb87770df140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:33.980787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3ca0f399-cbe2-4738-8bc7-bb87770df140 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:33.982036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3ca0f399-cbe2-4738-8bc7-bb87770df140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:33.990544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:34.144999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616c26-0b7e-491d-823b-202373590033 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:34.159201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616c26-0b7e-491d-823b-202373590033 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:34.165435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c71da-6376-45f7-b67a-f792d1bbdd18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:34.166045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c71da-6376-45f7-b67a-f792d1bbdd18 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:34.166325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c71da-6376-45f7-b67a-f792d1bbdd18 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:34.166593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c71da-6376-45f7-b67a-f792d1bbdd18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:34.174432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c71da-6376-45f7-b67a-f792d1bbdd18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:34.176906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c71da-6376-45f7-b67a-f792d1bbdd18 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:34.186061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 773/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:35.013919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2667c-50d7-4f48-922c-d33e486167a3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:35.014513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2667c-50d7-4f48-922c-d33e486167a3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:35.014513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2667c-50d7-4f48-922c-d33e486167a3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:35.015819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 30 00:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:35.021476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50901b-e0d9-4ed4-b14c-149925f297b1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:35.021949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50901b-e0d9-4ed4-b14c-149925f297b1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:35.022087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f50901b-e0d9-4ed4-b14c-149925f297b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:35.041382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5f50901b-e0d9-4ed4-b14c-149925f297b1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:35.042621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5f50901b-e0d9-4ed4-b14c-149925f297b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:35.050570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 30 00:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:35.205653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2667c-50d7-4f48-922c-d33e486167a3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:35.220457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2667c-50d7-4f48-922c-d33e486167a3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:35.225899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ba467-c6e2-4e3f-b926-6a25a70a525c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:35.226497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba467-c6e2-4e3f-b926-6a25a70a525c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:35.226787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba467-c6e2-4e3f-b926-6a25a70a525c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:35.227062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ba467-c6e2-4e3f-b926-6a25a70a525c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:35.235115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ba467-c6e2-4e3f-b926-6a25a70a525c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:35.236706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ba467-c6e2-4e3f-b926-6a25a70a525c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:35.246634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 753/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:39.233261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6da138-3dd7-4020-9df3-77d3620cb444 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:39.233816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6da138-3dd7-4020-9df3-77d3620cb444 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:39.233816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6da138-3dd7-4020-9df3-77d3620cb444 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:39.235090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:39.240766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24a6d1-486b-43d3-9bb0-6ef170d6e6a6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:39.241195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24a6d1-486b-43d3-9bb0-6ef170d6e6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:39.241307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24a6d1-486b-43d3-9bb0-6ef170d6e6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:39.261283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fc24a6d1-486b-43d3-9bb0-6ef170d6e6a6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:39.262498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fc24a6d1-486b-43d3-9bb0-6ef170d6e6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:39.270985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:13:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:39.562111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6da138-3dd7-4020-9df3-77d3620cb444 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:39.564093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5e6da138-3dd7-4020-9df3-77d3620cb444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:39.642447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6da138-3dd7-4020-9df3-77d3620cb444 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:39.646029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d910c7d-ad1f-4800-9d3b-f92f1fb0b843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:39.646624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910c7d-ad1f-4800-9d3b-f92f1fb0b843 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:39.646904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910c7d-ad1f-4800-9d3b-f92f1fb0b843 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:39.647177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d910c7d-ad1f-4800-9d3b-f92f1fb0b843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:39.655919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d910c7d-ad1f-4800-9d3b-f92f1fb0b843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:39.657324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d910c7d-ad1f-4800-9d3b-f92f1fb0b843 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:39.667359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 776/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:41.583848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b05eb-5790-42d3-a118-9d9db416e8e9 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:41.584388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b05eb-5790-42d3-a118-9d9db416e8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:41.584503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b05eb-5790-42d3-a118-9d9db416e8e9 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:41.585855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:41.591114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3931a6-f73c-423d-a78f-3980ae34d8e3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:41.591491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3931a6-f73c-423d-a78f-3980ae34d8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:41.591684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3931a6-f73c-423d-a78f-3980ae34d8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:41.611992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5f3931a6-f73c-423d-a78f-3980ae34d8e3 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:41.613803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5f3931a6-f73c-423d-a78f-3980ae34d8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:41.621698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:41.915113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b05eb-5790-42d3-a118-9d9db416e8e9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:41.927234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b05eb-5790-42d3-a118-9d9db416e8e9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:41.930848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6b0c0-aad9-43c5-b737-9e1b73d24351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:41.931446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6b0c0-aad9-43c5-b737-9e1b73d24351 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:41.931725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6b0c0-aad9-43c5-b737-9e1b73d24351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:41.931998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6b0c0-aad9-43c5-b737-9e1b73d24351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:41.940918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6b0c0-aad9-43c5-b737-9e1b73d24351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:41.942457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6b0c0-aad9-43c5-b737-9e1b73d24351 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:41.960717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 756/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:45.761268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d39db-da27-4ff5-a3f6-598e176e9653 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:45.761863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d39db-da27-4ff5-a3f6-598e176e9653 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:45.761863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d39db-da27-4ff5-a3f6-598e176e9653 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:45.763176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:45.768633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf6f94-1625-416e-975a-b5d2ade6f03b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:45.769077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf6f94-1625-416e-975a-b5d2ade6f03b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:45.769296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf6f94-1625-416e-975a-b5d2ade6f03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:45.776873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=81 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:45.790187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-34cf6f94-1625-416e-975a-b5d2ade6f03b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:45.791391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-34cf6f94-1625-416e-975a-b5d2ade6f03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:45.799201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:46.350594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d39db-da27-4ff5-a3f6-598e176e9653 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:46.352508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-390d39db-da27-4ff5-a3f6-598e176e9653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:46.416730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:46.430556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d39db-da27-4ff5-a3f6-598e176e9653 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:46.434057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9354e-0147-4c21-864c-857842defccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:46.434655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9354e-0147-4c21-864c-857842defccd service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:46.434935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9354e-0147-4c21-864c-857842defccd service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:46.435205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9354e-0147-4c21-864c-857842defccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:46.444169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9354e-0147-4c21-864c-857842defccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:46.445578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9354e-0147-4c21-864c-857842defccd service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:46.454689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 779/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:48.380391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2a66-47f6-4c20-9032-468a1eb41d04 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:48.380967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2a66-47f6-4c20-9032-468a1eb41d04 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:48.380967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e2a66-47f6-4c20-9032-468a1eb41d04 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:48.382345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Aug 30 00:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:13:48.387370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58548f-9254-40eb-a979-af988fbb4b80 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:48.387758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58548f-9254-40eb-a979-af988fbb4b80 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:48.387923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58548f-9254-40eb-a979-af988fbb4b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:48.407353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6f58548f-9254-40eb-a979-af988fbb4b80 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:13:48.408542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6f58548f-9254-40eb-a979-af988fbb4b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:48.419546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Aug 30 00:13:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:13:48.962163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e2a66-47f6-4c20-9032-468a1eb41d04 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:13:48.963944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-114e2a66-47f6-4c20-9032-468a1eb41d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:13:48.977820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e2a66-47f6-4c20-9032-468a1eb41d04 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:13:48.981364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f685-148f-499b-9a09-345d561700af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:13:48.982005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f685-148f-499b-9a09-345d561700af service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:13:48.982292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f685-148f-499b-9a09-345d561700af service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:13:48.982570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f685-148f-499b-9a09-345d561700af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:13:48.991655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1f685-148f-499b-9a09-345d561700af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:13:48.993080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1f685-148f-499b-9a09-345d561700af service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:13:49.002412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 759/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:13:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:13:58.402565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=11 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:13:58.998238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=8 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:20.021227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.022872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.022872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.046246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.047469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.058252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 781/1540] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.067316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.067905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.067905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.104477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.105717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.115633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 760/1541] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.120592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.135808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e7000-b602-43ba-a4c6-2f51f0989397 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.140853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.141503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.141829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.142105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.142788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:20.143094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.145541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bbbac-c80d-449a-ac8e-7cc1c0319a57 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.164739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 782/1542] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:20.172865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.183767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038bb5a2-567d-4411-908b-7ba834dda75d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.201516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.202173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.202454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.202725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.203368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.205284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.240178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08154b-5bb4-46df-926e-d413a0f75dd7 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.240508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08154b-5bb4-46df-926e-d413a0f75dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.241694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08154b-5bb4-46df-926e-d413a0f75dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.277366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ed08154b-5bb4-46df-926e-d413a0f75dd7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.278694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 761/1543] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:20.282459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ed08154b-5bb4-46df-926e-d413a0f75dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.283383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.412586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa401f7-7d13-4244-8ea2-0cbea93670c2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.431953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.433120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.433399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.433667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.434335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.435081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 783/1544] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.435362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:15:20.435362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:15:20.435362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:15:20.438189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b3a895-e7e7-4cba-a836-047436f0bc27 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.439826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.440712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.441233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.481448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 762/1545] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/users => generated 279 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:15:20.482829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ebe6-a26c-4477-8d97-eebb70538f4f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.483135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ebe6-a26c-4477-8d97-eebb70538f4f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.483390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0ebe6-a26c-4477-8d97-eebb70538f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.485155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.486684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.510243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 784/1546] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.511527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.522851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-24a0ebe6-a26c-4477-8d97-eebb70538f4f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.522851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-24a0ebe6-a26c-4477-8d97-eebb70538f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.530293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7073e-e7d9-436b-9b64-c9906d09130c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.539790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6125a12-bd1d-41d6-8590-17b4095fa2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.541186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 763/1547] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.541795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6125a12-bd1d-41d6-8590-17b4095fa2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.542315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6125a12-bd1d-41d6-8590-17b4095fa2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.542507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.542746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.543022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.543438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6125a12-bd1d-41d6-8590-17b4095fa2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.544340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6125a12-bd1d-41d6-8590-17b4095fa2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.546622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6125a12-bd1d-41d6-8590-17b4095fa2a1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.580980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.582670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.588024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 785/1548] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:20.589658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d7fa3-c75f-4631-9d0b-28637f2d46a9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.590225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d7fa3-c75f-4631-9d0b-28637f2d46a9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.590730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d7fa3-c75f-4631-9d0b-28637f2d46a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.607646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 764/1549] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.608775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.631457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ab1d7fa3-c75f-4631-9d0b-28637f2d46a9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.632672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ab1d7fa3-c75f-4631-9d0b-28637f2d46a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.637132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25814b8-9864-4657-a8eb-e4ed4609ee1b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.646345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.646989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.647267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.647538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.650046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:20.651019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.652059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:15:20.652059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:15:20.652059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:15:20.652980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.657914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 786/1550] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.659312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298149-318a-40b2-b034-01db1ac322a5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.659600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298149-318a-40b2-b034-01db1ac322a5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.659868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298149-318a-40b2-b034-01db1ac322a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.673553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 765/1551] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:20.675042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.687111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b4298149-318a-40b2-b034-01db1ac322a5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.688529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b4298149-318a-40b2-b034-01db1ac322a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.704211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17427e17-6e65-4afe-b15d-0eaf44bc6bc2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.706099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 787/1552] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.709048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.709311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.709586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.718502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafccbd8-5d37-4ed2-b507-81275b07aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.719208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccbd8-5d37-4ed2-b507-81275b07aff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.719518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccbd8-5d37-4ed2-b507-81275b07aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.719751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafccbd8-5d37-4ed2-b507-81275b07aff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.720582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafccbd8-5d37-4ed2-b507-81275b07aff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.722212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafccbd8-5d37-4ed2-b507-81275b07aff0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.732591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.733828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.737276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 766/1553] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:20 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:20.739214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.739479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.739834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.743730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 788/1554] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.744536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.754456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b07ad-41e1-4c85-9599-7017d113e411 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.759418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.760023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.760134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.760284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.760553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.761192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:20.761316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.761490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.763099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec378544-5c6c-421d-a966-bd7fe192f4fb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.769595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 767/1555] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.770770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.780270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 789/1556] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:20.780424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337bc16-d239-4b5d-b2f7-0309f87e49c0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.781351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004df32-4940-4afb-b9ea-82381173bc9a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.781639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004df32-4940-4afb-b9ea-82381173bc9a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.781994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004df32-4940-4afb-b9ea-82381173bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.786068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70321a94-1e19-4c86-9274-9e7342d23fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.786962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321a94-1e19-4c86-9274-9e7342d23fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.787314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321a94-1e19-4c86-9274-9e7342d23fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.787594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70321a94-1e19-4c86-9274-9e7342d23fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.788229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321a94-1e19-4c86-9274-9e7342d23fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.790193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70321a94-1e19-4c86-9274-9e7342d23fa5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.803214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5004df32-4940-4afb-b9ea-82381173bc9a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.804442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5004df32-4940-4afb-b9ea-82381173bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.814327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 790/1557] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.821652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.821652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.821652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.826153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 768/1558] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/projects => generated 389 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:20.826153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.826153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.826153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.836764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.838149 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.844646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.845956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:20.888649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:20.901171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 791/1559] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.902169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.911402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd44a4d-ca46-415b-b5ee-4ac07ea87666 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.913159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 769/1560] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:20.914102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.923720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.924398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.924520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b59d8d9-e7ae-43be-a21b-451daf23e7fc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:20.924680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.924957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] PATH_INFO: `/v3/projects/cc3fc5b9a859442180700cbeb69d9fc8/users/6877e6e4715547608e390733b912f5ac/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.929927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:20.930554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.930839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.931115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.931798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:20.932111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.933734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40903375-a57c-466d-9b9b-35d56755534d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.940746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3fc5b9a859442180700cbeb69d9fc8, user_id=6877e6e4715547608e390733b912f5ac, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:20.942393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:15:20.942393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:15:20.942393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:15:20.944320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:20.946398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 770/1561] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:20.947598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4dfb-585a-4164-8477-f3a9e817ca60 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:20.947888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4dfb-585a-4164-8477-f3a9e817ca60 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:20.948168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f4dfb-585a-4164-8477-f3a9e817ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:20.960172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:20.966270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 792/1562] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:20 2022] PUT /identity/v3/projects/cc3fc5b9a859442180700cbeb69d9fc8/users/6877e6e4715547608e390733b912f5ac/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:20.967341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:20.969118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f79f4dfb-585a-4164-8477-f3a9e817ca60 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:20.970476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f79f4dfb-585a-4164-8477-f3a9e817ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:21.031745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 771/1563] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:21.033062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.033358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.033634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.041458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50a364c-4740-490f-a9eb-5f1a33ee805c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.047909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.048522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.048809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.049086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.049762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.051354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:15:21.051354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:15:21.051354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:15:21.052876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.053077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:21.054311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:21.062602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 772/1564] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:21.063363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.076086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa9d2b-a21e-431a-a4bc-fdba908609f4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.080753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e4f0c4-2676-45c5-a956-fb1caec2ae1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.085171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 793/1565] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:20 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.085327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f0c4-2676-45c5-a956-fb1caec2ae1e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.085327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f0c4-2676-45c5-a956-fb1caec2ae1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.085327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e4f0c4-2676-45c5-a956-fb1caec2ae1e admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.085565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.085657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f0c4-2676-45c5-a956-fb1caec2ae1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.085657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e4f0c4-2676-45c5-a956-fb1caec2ae1e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.110458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 773/1566] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 295 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.110458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f6af-ee13-4a26-aed5-e6f8ce1b73fc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.110458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f6af-ee13-4a26-aed5-e6f8ce1b73fc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.110458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905f6af-ee13-4a26-aed5-e6f8ce1b73fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.130739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9905f6af-ee13-4a26-aed5-e6f8ce1b73fc None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:21.131986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9905f6af-ee13-4a26-aed5-e6f8ce1b73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:21.155060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88000ae9-873c-4d3c-92ed-4118e2ed15c6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.159670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.160875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.161167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.161441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.162120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:21.162426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.164015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.175319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 794/1567] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:21.177174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.186690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bab34-db8b-4d9d-95d5-e23567ff2f78 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.192221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.193258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.193535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.193837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.194460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.196324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.200422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 774/1568] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:21.201654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.201991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.202269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.225128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 795/1569] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.226135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.230889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] MFA Rules not processed for user `6877e6e4715547608e390733b912f5ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:21.232102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:21.274178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:21.288284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:21.292144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724283f-3dd4-46e2-b1b9-153f13958e3d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.298083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.298699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.299160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.299442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.300099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:21.300408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.304775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 775/1570] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:21.304953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.305052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.314880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68d463-9aca-40a3-9fd8-9071d6f8bbd4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.315303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 796/1571] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:21.316100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.320299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.321207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.321498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.321793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.322438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:21.322738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.324730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.328674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf01ed-10df-466e-8d7a-e7f3cf9e5811 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.334152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.334753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.335037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.335317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.335948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.337597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 776/1572] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:21.338092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.338485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.348330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f6722-541d-4801-9173-b7f1c80b2096 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.353686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.354303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.354586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.354864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.355539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.357262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.361139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 797/1573] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 292 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.361882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.373078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 777/1574] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:21.373078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.373382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edd17a-d2ab-49cf-8acb-451d2d3e30f5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.377591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.378221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.378503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.378777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.380211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.381370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f8808-3c63-4e8e-bd44-d8e103ad0b26 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.382147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.385985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.386574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.386856 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.387137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.387775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:21.388080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.389643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.402622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 778/1575] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:21.403986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.416924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7dbf17-a1db-43f4-9e23-ce42b24bb4ae admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.419141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 798/1576] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.421846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.422518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.422881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.422982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.423159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.423798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.425839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.448937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 779/1577] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.449665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.460109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb4461d-63d9-46b4-b6c8-9bcfdbce7e97 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.489492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df952fa-0fc2-45ec-9b50-3e53aad577d0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.494365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.494969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.495253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.495533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.496194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.498224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.517505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.518127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.518557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.518850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.520311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.522291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.526531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 799/1578] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/projects => generated 355 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.530446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.550875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 780/1579] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.552006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.596007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a3a31-7116-425c-bfd0-6394f10926d6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.613669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea04557-715b-43dc-8a32-a9d97825844e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.618522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.619249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.619605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.619884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.620533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.622282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.632656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 781/1580] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:21.633467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.642257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:21.643504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636012c2-10b1-4429-9371-e6746b9c35af admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.649035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.649634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.650057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.650506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.650968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.652640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.654103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:21.659611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.660264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.660730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.661281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.661956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.663939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.667944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 782/1581] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:21.669039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.680109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a37ab-6a91-4ec7-a640-ea23ec53f52b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.685448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.686074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.686487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.686769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.687429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.689335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.694388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 800/1582] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/projects => generated 381 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.695211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.723883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 783/1583] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.723883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.760589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa742980-44e4-438e-b86c-62d6fadaab31 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.789259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8af89-6c14-42dd-ba97-d0d8b32c8c40 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.793996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.794599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.794878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.795191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.795865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.797522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.807932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 784/1584] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:21.808836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.818701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9f72c-3f2d-42cd-ba1a-fcc35813939b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.819021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.819629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.819909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.820181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.820813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.822770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.823467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.824041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.824325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.824601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.825225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.827154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.844862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 801/1585] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.845919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.849440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 785/1586] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 284 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.850297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.856897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075c74f4-d7d5-4d94-81e9-d3e4cdb742cf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.859998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca227797-9ab5-4b68-b796-5f869dd675ac admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.861765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.862364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.862649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.862924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.863818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.864617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.865200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.865484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.865755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.865868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.866432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.868175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.880382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 786/1587] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:21.881802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.892630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 802/1588] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.892630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.896144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915d8417-de3f-43d7-b39f-a56f967ac02e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.900817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.901248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df451b-ee73-48b3-b766-0e685fd533d7 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.901473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.901822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.902102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] PATH_INFO: `/v3/projects/149deb9276324f678793539913830ebc/users/66526665148e4f1792868ce8d0c449f4/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.905902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:21.906487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:21.906771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:21.907044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:21.907670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.909595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.919126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] RBAC: Authorizing `identity:create_grant(project_id=149deb9276324f678793539913830ebc, user_id=66526665148e4f1792868ce8d0c449f4, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:21.922808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:21.933857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 803/1589] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:21.934676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.939011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 787/1590] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:21 2022] PUT /identity/v3/projects/149deb9276324f678793539913830ebc/users/66526665148e4f1792868ce8d0c449f4/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:21.943295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:21.946386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb578b9-4585-424e-ae02-93a65cf39f3c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:21.975602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:22.005105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.005726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.006018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.006303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.006933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.008531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feb7aa-ac39-4170-b418-978168e2824b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.008852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.013157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.013782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.014097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.014380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.015057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.016720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.027913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 788/1591] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.028740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.033590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 804/1592] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:21 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:22.034721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.038667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e932b4-4e03-4679-a2cc-397b30f8087d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.043386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.043987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.044275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.044554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.045197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.045755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3151ddfa-a203-4eff-8fb5-13f096dcc9f6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.046837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.050608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.051236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.051577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.051865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.052511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.054233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.056860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 789/1593] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.057640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.062681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:22.069519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 805/1594] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.069519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.069804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1ddef-77ec-46a8-837f-34f4eb6edc41 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.074593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83297911-8bf3-4504-b237-e904fca1e44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.075257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297911-8bf3-4504-b237-e904fca1e44f admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.075541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297911-8bf3-4504-b237-e904fca1e44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.075817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83297911-8bf3-4504-b237-e904fca1e44f admin admin] PATH_INFO: `/v3/projects/e958bcb778544b6a94c134030250d177/users/a7a214f6d0fa424e8c54e1934e0a6fa9/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.080235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8502a-7313-408a-8837-7795353c690e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.085924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.086523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.086808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.087089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.087731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.089320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.092813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297911-8bf3-4504-b237-e904fca1e44f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e958bcb778544b6a94c134030250d177, user_id=a7a214f6d0fa424e8c54e1934e0a6fa9, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.095488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83297911-8bf3-4504-b237-e904fca1e44f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.099996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 806/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.101308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.109298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 790/1596] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/e958bcb778544b6a94c134030250d177/users/a7a214f6d0fa424e8c54e1934e0a6fa9/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.110858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.111303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.111765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.111967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86860452-1173-4226-bd0e-ccb1ed7a35ac admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.131215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:22.132549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:22.170164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.170778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.171064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.171341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.171985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.173584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.183483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 807/1597] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.186615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.192509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 791/1598] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:22.193342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.197230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7487e-ebbb-4ea0-9544-c6e43e93e70e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.202072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.202720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.202835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f7c91-0ea3-4f39-bc79-1369af18a868 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.203021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.203291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] PATH_INFO: `/v3/projects/3f24978c195d4fc9a31c33c6408c9b8b/users/871e8a8e1baa48fb9923e12562921a50/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.208435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.209126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.209474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.209838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.210493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.212114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.219661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f24978c195d4fc9a31c33c6408c9b8b, user_id=871e8a8e1baa48fb9923e12562921a50, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.222183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 792/1599] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.222333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.223128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.233109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53c692-4082-477e-b9b6-aa678199ddf2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.236645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 808/1600] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/3f24978c195d4fc9a31c33c6408c9b8b/users/871e8a8e1baa48fb9923e12562921a50/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.237672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.293417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.294344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.294625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.294900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.295567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.297187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.306281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600482d2-cec1-40e0-8443-e5dbd4a0838c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.307112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 793/1601] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.308994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.311703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.312520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.312812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.313156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] PATH_INFO: `/v3/projects/f7a27d5d4b2f41b2a616e6a6d6b977a0/users/0d6c2076562e46d496b419fa4d6fb266/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.319680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47402cf-e9cd-427e-8d85-31fd0a9d1162 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.324721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2029dd-4c85-4a25-9136-41e20fd33fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.325373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2029dd-4c85-4a25-9136-41e20fd33fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.325660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2029dd-4c85-4a25-9136-41e20fd33fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.325989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2029dd-4c85-4a25-9136-41e20fd33fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.326679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2029dd-4c85-4a25-9136-41e20fd33fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.328442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2029dd-4c85-4a25-9136-41e20fd33fb7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.329083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a27d5d4b2f41b2a616e6a6d6b977a0, user_id=0d6c2076562e46d496b419fa4d6fb266, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.331775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.335859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:22.340185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 794/1602] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.341376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.341734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.342010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.349652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 809/1603] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/f7a27d5d4b2f41b2a616e6a6d6b977a0/users/0d6c2076562e46d496b419fa4d6fb266/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.350475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.364422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:22.365626 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:22.412419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279481ec-6efc-4816-a3f6-6650b3b89602 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.414674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:22.417185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.417815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.418197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.418475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.419125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.420787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.428461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 795/1604] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:22.429469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.434006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 810/1605] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.434006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.442444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ead1-cb86-49d2-bf8d-2f3afab0683b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.447041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8349d73b-eb59-4575-b7f7-e1d5bce1aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.447632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349d73b-eb59-4575-b7f7-e1d5bce1aacd admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.447910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349d73b-eb59-4575-b7f7-e1d5bce1aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.448180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8349d73b-eb59-4575-b7f7-e1d5bce1aacd admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.448812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349d73b-eb59-4575-b7f7-e1d5bce1aacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.450437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8349d73b-eb59-4575-b7f7-e1d5bce1aacd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.460412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 811/1606] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.461565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.461875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.462146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.490217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] MFA Rules not processed for user `871e8a8e1baa48fb9923e12562921a50`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:22.491332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:22.493249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0647a-7ff1-42fb-b359-2302a9281a04 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.497251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.497924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.498212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.498487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.509030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.510530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.521323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 796/1607] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:22.521963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.530867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500aef0-ba06-47ae-acfd-e6e5954167c1 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.536224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.536903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.537183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.537457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] PATH_INFO: `/v3/projects/e4ee33721add4315b74b076f2f536c0f/users/0ba2a01503894fe4be71f54aff8807c5/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.555420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4ee33721add4315b74b076f2f536c0f, user_id=0ba2a01503894fe4be71f54aff8807c5, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.558193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.560649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 812/1608] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:22.561563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.574354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847abec-c988-4d55-96c2-6b7b07d10b0d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.578912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 797/1609] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/e4ee33721add4315b74b076f2f536c0f/users/0ba2a01503894fe4be71f54aff8807c5/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.578912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.649913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.650623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.650900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.651285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] PATH_INFO: `/v3/projects/88043ef8a7834208a50a12573d5ec5b5/users/ea5524cca92f42c3841e74995edee832/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.653811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce55283-c034-43ad-9768-1dbd68923026 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.659259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.660695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.661136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.661502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.662252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.664054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.667045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:22.671466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88043ef8a7834208a50a12573d5ec5b5, user_id=ea5524cca92f42c3841e74995edee832, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.675082 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.677960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 798/1610] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:22.678878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.690411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a3ee0-1b40-4223-a9b7-1fc6e359b08e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.700140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 813/1611] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/88043ef8a7834208a50a12573d5ec5b5/users/ea5524cca92f42c3841e74995edee832/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.702020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.766367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.766967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.767156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.767422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] PATH_INFO: `/v3/projects/d96ee780ba66441c93874d478eb96899/users/473589941a6848ef9d4cfae507b84234/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.779012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4e4e0-1079-45c6-b72d-81dfa74dfa9c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.782438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:22.782823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.783442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.783729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.784023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.787240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96ee780ba66441c93874d478eb96899, user_id=473589941a6848ef9d4cfae507b84234, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.790853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.794388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.796083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.807127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 799/1612] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/d96ee780ba66441c93874d478eb96899/users/473589941a6848ef9d4cfae507b84234/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.807362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 814/1613] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:22.808272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.808850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.827725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bf6ff-0e6e-41e0-b536-5e9e2db165fd service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.896786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93913d3a-96b1-44b5-abca-de9ce0fe4310 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:22.900074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b084c-a438-444e-8754-9d30bdda0721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.900936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b084c-a438-444e-8754-9d30bdda0721 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.901167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b084c-a438-444e-8754-9d30bdda0721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.901451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b084c-a438-444e-8754-9d30bdda0721 admin admin] PATH_INFO: `/v3/projects/b47eda710b6841efbed5b323497e608e/users/d8e6d4ffefda4a2ea7ac2ab7b61158e0/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.903044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:22.904335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.905391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.905391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.905776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.907732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.918848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b084c-a438-444e-8754-9d30bdda0721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47eda710b6841efbed5b323497e608e, user_id=d8e6d4ffefda4a2ea7ac2ab7b61158e0, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:22.921960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b084c-a438-444e-8754-9d30bdda0721 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:22.938458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 815/1614] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/b47eda710b6841efbed5b323497e608e/users/d8e6d4ffefda4a2ea7ac2ab7b61158e0/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:22.939800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6786-2041-4ed0-a256-a216bcee0904 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:22.940096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6786-2041-4ed0-a256-a216bcee0904 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:22.940374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6786-2041-4ed0-a256-a216bcee0904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:22.948295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 800/1615] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:22 2022] POST /identity/v3/projects => generated 369 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:22.949982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:22.961098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-70ef6786-2041-4ed0-a256-a216bcee0904 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:22.962372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-70ef6786-2041-4ed0-a256-a216bcee0904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:23.030590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 816/1616] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:23.031042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6e625-5d36-4814-a3ae-ea204b15a5d5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.032055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2b695-e67a-4f48-9c94-02494787b719 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.032355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2b695-e67a-4f48-9c94-02494787b719 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.032689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2b695-e67a-4f48-9c94-02494787b719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.042800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6943b3-37e9-4203-aeae-e087208fdb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.043457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6943b3-37e9-4203-aeae-e087208fdb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.043749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6943b3-37e9-4203-aeae-e087208fdb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.044029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6943b3-37e9-4203-aeae-e087208fdb8d admin admin] PATH_INFO: `/v3/projects/f7a27d5d4b2f41b2a616e6a6d6b977a0/users/0d6c2076562e46d496b419fa4d6fb266/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.046672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6943b3-37e9-4203-aeae-e087208fdb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a27d5d4b2f41b2a616e6a6d6b977a0, user_id=0d6c2076562e46d496b419fa4d6fb266, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.050085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6943b3-37e9-4203-aeae-e087208fdb8d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.054781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2fc2b695-e67a-4f48-9c94-02494787b719 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:23.056077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2fc2b695-e67a-4f48-9c94-02494787b719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:23.073535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 801/1617] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:22 2022] PUT /identity/v3/projects/f7a27d5d4b2f41b2a616e6a6d6b977a0/users/0d6c2076562e46d496b419fa4d6fb266/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:23.073535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.073535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.073535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.074063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:23.100445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] MFA Rules not processed for user `473589941a6848ef9d4cfae507b84234`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:23.102247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:23.123482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 817/1618] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:23.124961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.125237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.125538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.147522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:23.148759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:23.157203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 818/1619] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:23.158501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.169693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd69636-aeae-45f6-aff5-e546826199fa None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.176932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf85f6-28d5-4929-aa59-daf42829084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.177687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf85f6-28d5-4929-aa59-daf42829084d admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.178097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf85f6-28d5-4929-aa59-daf42829084d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.178909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf85f6-28d5-4929-aa59-daf42829084d admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.179124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:23.179289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf85f6-28d5-4929-aa59-daf42829084d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.182505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf85f6-28d5-4929-aa59-daf42829084d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.187497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 802/1620] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:23.188595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.191375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:23.215903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 819/1621] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:23.218054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.218508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.219429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.263633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] MFA Rules not processed for user `0d6c2076562e46d496b419fa4d6fb266`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:23.265066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:23.271506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56da939-ffdc-4b39-b9ef-6c8fb986e45e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.290719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.291729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.293953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.295355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.326347 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.327936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.346842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 803/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:23.348520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.362847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69ac0-7556-4fae-97b8-ba4b799812ea service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.383271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.384060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.384195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.384426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.385062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.386813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 820/1623] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:23.387572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.388588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.414831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68262-8693-423f-9494-0f2cf58fd536 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.425233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.427179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 804/1624] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/projects => generated 381 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:23.428649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.428840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.429320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.429943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.454973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.461729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.490760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 821/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:23.495068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.516960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950e6bd0-6e17-4529-8c49-22c0997ea40e service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.524023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c2cdf-8d0c-42d3-b1c8-c53d436d7f6c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.528828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.529733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.530192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.530613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.623527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.624645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.624978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.626133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.626793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.630476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.641793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.643637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.653444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 822/1626] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:23.653444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.657886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:23.660843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 805/1627] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:23.661962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.673431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f5c5bd-1c34-475a-8ebd-2710537b9f32 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.683941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.684575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.684858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.685130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.686005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.689055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.725402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 806/1628] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:23 2022] POST /identity/v3/users => generated 297 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:23.725402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.740991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd916bd1-0a09-4e11-afee-0c8c415c689c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.741501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af75a42-939b-4b80-9772-cd236081e9cb admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.746920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.747841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.748161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.748401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.748828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.749798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.750277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.750730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] PATH_INFO: `/v3/projects/cb9308eb7ca6491982fa3d8a7d087921/users/8bd9ac625a1f4bb491b35e3628258cfb/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.781283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:23.791184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9308eb7ca6491982fa3d8a7d087921, user_id=8bd9ac625a1f4bb491b35e3628258cfb, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.797744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.823723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 807/1629] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:23 2022] PUT /identity/v3/projects/cb9308eb7ca6491982fa3d8a7d087921/users/8bd9ac625a1f4bb491b35e3628258cfb/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:23.825511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.875714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.877940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:23.901087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 823/1630] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:23.902167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:23.931307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fb452-9e58-4d1e-b8ea-fc290892f8d6 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.962479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4923169a-c4ed-4025-b13e-853aac5c2b86 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:23.986328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:23.988126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:23.989343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:23.991666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:23.992578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:23.997660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.012843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.015779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.016269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.017994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.019038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.023533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.029629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 808/1631] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:24.030836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.049798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 824/1632] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:24.051709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45456a-e146-46e6-952d-65767d2a0843 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.052451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.058941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa083-ce52-4e0e-9706-13b555da2b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.059787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa083-ce52-4e0e-9706-13b555da2b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.060342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa083-ce52-4e0e-9706-13b555da2b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.062402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa083-ce52-4e0e-9706-13b555da2b4b admin admin] PATH_INFO: `/v3/projects/b6e0f362acd74dfea91bbfd3dfeb1dc8/users/5a974733cb9c47489d87e6f8d54141e5/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.067522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c15d4-d02d-4831-953e-82f39b7056af admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.079764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.080668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.081562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.082482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] PATH_INFO: `/v3/projects/cb9308eb7ca6491982fa3d8a7d087921/users/8bd9ac625a1f4bb491b35e3628258cfb/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.087012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9308eb7ca6491982fa3d8a7d087921, user_id=8bd9ac625a1f4bb491b35e3628258cfb, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.091283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.096695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fa083-ce52-4e0e-9706-13b555da2b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e0f362acd74dfea91bbfd3dfeb1dc8, user_id=5a974733cb9c47489d87e6f8d54141e5, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.100523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fa083-ce52-4e0e-9706-13b555da2b4b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.109809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 825/1633] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:24 2022] PUT /identity/v3/projects/cb9308eb7ca6491982fa3d8a7d087921/users/8bd9ac625a1f4bb491b35e3628258cfb/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:24.111803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.135073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 809/1634] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:24 2022] PUT /identity/v3/projects/b6e0f362acd74dfea91bbfd3dfeb1dc8/users/5a974733cb9c47489d87e6f8d54141e5/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:24.136991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.137942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.138365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.172886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:24.190055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] MFA Rules not processed for user `8bd9ac625a1f4bb491b35e3628258cfb`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:24.190055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:24.201070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bf4a2-1612-4597-b532-bb1affcd7d14 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.272123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.273495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.274006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.274425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.363913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.366207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.380402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 826/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:24.391913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.431798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 810/1636] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:24.444234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.459654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b59f51-4400-4328-9894-6829ee5349f3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.469637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.470300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.470582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.470855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.498915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.500405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.522577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 811/1637] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:24.560067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e6036-fed5-4f30-afe4-20dd2dc529ca service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.584973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.589137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.590322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.591645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.594678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.601307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.654494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 827/1638] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:24.658975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.680669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22407685-f1e0-4aa1-8d27-9524422fcaa7 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.695404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce35de-4bcb-4b89-8615-ffa4e61ac0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.698446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce35de-4bcb-4b89-8615-ffa4e61ac0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.700071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce35de-4bcb-4b89-8615-ffa4e61ac0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.701197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce35de-4bcb-4b89-8615-ffa4e61ac0bc admin admin] PATH_INFO: `/v3/projects/b6e0f362acd74dfea91bbfd3dfeb1dc8/users/5a974733cb9c47489d87e6f8d54141e5/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.708563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce35de-4bcb-4b89-8615-ffa4e61ac0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e0f362acd74dfea91bbfd3dfeb1dc8, user_id=5a974733cb9c47489d87e6f8d54141e5, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:24.718540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce35de-4bcb-4b89-8615-ffa4e61ac0bc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:24.728016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:24.747568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb40dc-5e84-4c3d-bb23-e3001db1b9c9 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:24.765635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 812/1639] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:24 2022] PUT /identity/v3/projects/b6e0f362acd74dfea91bbfd3dfeb1dc8/users/5a974733cb9c47489d87e6f8d54141e5/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:24.777061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.777061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.777061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:24.887858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] MFA Rules not processed for user `5a974733cb9c47489d87e6f8d54141e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:24.892653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:24.931131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:24.936788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:24.959312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:24.960111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:24.961385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:24.961582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:25.048926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 813/1640] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:25.086109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:25.089559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:25.113871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 828/1641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:25.118069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:25.130772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270fb50-e523-4b6d-89a2-dd49c8d184c4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:25.137161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9813f47f-3b1b-48d1-8b65-bdc39abdc194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:25.137900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f47f-3b1b-48d1-8b65-bdc39abdc194 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:25.138627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f47f-3b1b-48d1-8b65-bdc39abdc194 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:25.138866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9813f47f-3b1b-48d1-8b65-bdc39abdc194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:25.156642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813f47f-3b1b-48d1-8b65-bdc39abdc194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:25.158260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9813f47f-3b1b-48d1-8b65-bdc39abdc194 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:25.171958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 814/1642] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:25.342345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:25.357024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a302aaba-ce2d-4f9f-94c3-f90d322ca50e service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:25.364144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82af518b-7db2-430c-8688-18c0585d3b40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:25.366746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af518b-7db2-430c-8688-18c0585d3b40 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:25.367767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af518b-7db2-430c-8688-18c0585d3b40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:25.368039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82af518b-7db2-430c-8688-18c0585d3b40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:25.563545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af518b-7db2-430c-8688-18c0585d3b40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:25.571698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82af518b-7db2-430c-8688-18c0585d3b40 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:25.602228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 829/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:31.615366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08116-1f68-44f1-931f-5c1b9c39f098 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:31.615944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08116-1f68-44f1-931f-5c1b9c39f098 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:31.616206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08116-1f68-44f1-931f-5c1b9c39f098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:31.677783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-58e08116-1f68-44f1-931f-5c1b9c39f098 None None] MFA Rules not processed for user `a7a214f6d0fa424e8c54e1934e0a6fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:31.679142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-58e08116-1f68-44f1-931f-5c1b9c39f098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:31.860449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 815/1644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:31.904091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3380b-7983-4869-ace9-1b6cd0f34250 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:31.904539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3380b-7983-4869-ace9-1b6cd0f34250 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:31.904702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3380b-7983-4869-ace9-1b6cd0f34250 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:31.906340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 830/1645] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 00:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:15:31.931520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:31.931765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:31.932147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:32.039179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:32.040458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:32.203453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:32.251223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3380b-7983-4869-ace9-1b6cd0f34250 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:32.254337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 816/1646] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 00:15:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:32.286373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3380b-7983-4869-ace9-1b6cd0f34250 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:32.300770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25356b13-9c13-41b7-926d-7117c231399f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:32.302867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356b13-9c13-41b7-926d-7117c231399f service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:32.303190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356b13-9c13-41b7-926d-7117c231399f service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:32.305172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25356b13-9c13-41b7-926d-7117c231399f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:32.328706 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25356b13-9c13-41b7-926d-7117c231399f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:32.344338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25356b13-9c13-41b7-926d-7117c231399f service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:32.375085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 831/1647] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:35.127705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:35.368348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b932527-6304-4fc6-b0d1-0de46cc9ece8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:35.389342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:35.390057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:35.390342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:35.390618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] PATH_INFO: `/v3/users/473589941a6848ef9d4cfae507b84234` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:35.391832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473589941a6848ef9d4cfae507b84234)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:35.393875 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:35.504100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473589941a6848ef9d4cfae507b84234'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:35.520786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473589941a6848ef9d4cfae507b84234'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:35.521545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473589941a6848ef9d4cfae507b84234'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:35.541362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473589941a6848ef9d4cfae507b84234'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:35.542014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473589941a6848ef9d4cfae507b84234'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:35.587424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 817/1648] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:15:35 2022] DELETE /identity/v3/users/473589941a6848ef9d4cfae507b84234 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:35.592673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77e76-a5dd-4149-908e-96e039aeeeba None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:35.594102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77e76-a5dd-4149-908e-96e039aeeeba None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:35.594602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77e76-a5dd-4149-908e-96e039aeeeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:35.643394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2bb77e76-a5dd-4149-908e-96e039aeeeba None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:35.646656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2bb77e76-a5dd-4149-908e-96e039aeeeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:35.814290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 832/1649] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:35.942044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:35.943742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:36.033202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d557-959b-4d7e-ab2d-ae7e87ea99aa None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:36.033847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d557-959b-4d7e-ab2d-ae7e87ea99aa None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:36.034392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6d557-959b-4d7e-ab2d-ae7e87ea99aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:36.086677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5ae6d557-959b-4d7e-ab2d-ae7e87ea99aa None None] MFA Rules not processed for user `66526665148e4f1792868ce8d0c449f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:36.088435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5ae6d557-959b-4d7e-ab2d-ae7e87ea99aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:36.092954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3052b5-10d6-4889-8352-2355bf22fcd8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:36.098275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3dc66-0125-48cf-bc4d-d08e0c58ad34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:36.099029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc66-0125-48cf-bc4d-d08e0c58ad34 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:36.099309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc66-0125-48cf-bc4d-d08e0c58ad34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:36.099580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3dc66-0125-48cf-bc4d-d08e0c58ad34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:36.101445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:36.124871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3dc66-0125-48cf-bc4d-d08e0c58ad34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:36.126799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3dc66-0125-48cf-bc4d-d08e0c58ad34 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:36.177183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 818/1650] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:15:36.228219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 833/1651] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:36.266937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa40df-34e2-4542-a6cf-ca95e71b6ba6 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:36.267309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa40df-34e2-4542-a6cf-ca95e71b6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:36.267518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa40df-34e2-4542-a6cf-ca95e71b6ba6 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:36.269032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 819/1652] 10.222.0.43 () {54 vars in 962 bytes} [Tue Aug 30 00:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:15:36.289949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:36.290343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:36.290815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:36.350093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:36.354302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:36.572561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 834/1653] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Aug 30 00:15:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:36.581445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa40df-34e2-4542-a6cf-ca95e71b6ba6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:36.626938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa40df-34e2-4542-a6cf-ca95e71b6ba6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:36.643207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:36.644188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:36.644692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:36.645443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:36.674380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:36.678596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:36.714346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 820/1654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:38.999413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:39.003348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:39.032315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d822819-b2fd-4dcb-8d3b-b17b8449ef9d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:39.050262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:39.050262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:39.051609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:39.052052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] PATH_INFO: `/v3/projects/d96ee780ba66441c93874d478eb96899` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:39.055923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96ee780ba66441c93874d478eb96899)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:39.059043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:39.206586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96ee780ba66441c93874d478eb96899', 'request_id': 'req-982fa852-9eac-4121-babd-89767ca91579'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.228790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96ee780ba66441c93874d478eb96899', 'request_id': 'req-982fa852-9eac-4121-babd-89767ca91579'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.258727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96ee780ba66441c93874d478eb96899', 'request_id': 'req-982fa852-9eac-4121-babd-89767ca91579'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.315790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] The token cache is being invalidate because project d96ee780ba66441c93874d478eb96899 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:15:39.318247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.321696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-982fa852-9eac-4121-babd-89767ca91579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.331137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 835/1655] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:15:38 2022] DELETE /identity/v3/projects/d96ee780ba66441c93874d478eb96899 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:39.335828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:39.357042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e0a17-60ad-434d-b609-260757f16cc9 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:39.398503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:39.574931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:39.577275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:39.578357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:39.578760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] PATH_INFO: `/v3/users/5a974733cb9c47489d87e6f8d54141e5` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:39.582720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a974733cb9c47489d87e6f8d54141e5)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:39.586392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:39.638292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b55cc6-22de-42c8-a473-767eefe5fc64 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:39.638605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b55cc6-22de-42c8-a473-767eefe5fc64 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:39.639056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b55cc6-22de-42c8-a473-767eefe5fc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:39.700699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d5b55cc6-22de-42c8-a473-767eefe5fc64 None None] MFA Rules not processed for user `a7a214f6d0fa424e8c54e1934e0a6fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:39.703154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d5b55cc6-22de-42c8-a473-767eefe5fc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:39.752549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:39.778548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a974733cb9c47489d87e6f8d54141e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.810795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a974733cb9c47489d87e6f8d54141e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.811888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a974733cb9c47489d87e6f8d54141e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.834168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a974733cb9c47489d87e6f8d54141e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.834991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22b3bd77-7445-4c87-9bb2-66e1b86a32e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a974733cb9c47489d87e6f8d54141e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:39.850823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 836/1656] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:39 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:39.933358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 821/1657] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:15:39 2022] DELETE /identity/v3/users/5a974733cb9c47489d87e6f8d54141e5 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:40.021470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661acd65-f157-4fe4-ae6b-651d64087199 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:40.022458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661acd65-f157-4fe4-ae6b-651d64087199 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:40.022905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661acd65-f157-4fe4-ae6b-651d64087199 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:40.024538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 837/1658] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 00:15:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:15:40.033452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60563-8014-4dc0-9e1f-1221bf7a2fe7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:40.033802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60563-8014-4dc0-9e1f-1221bf7a2fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:40.034089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a60563-8014-4dc0-9e1f-1221bf7a2fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:40.081755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-11a60563-8014-4dc0-9e1f-1221bf7a2fe7 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:40.085964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-11a60563-8014-4dc0-9e1f-1221bf7a2fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:40.258283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 822/1659] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:15:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:40.274362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661acd65-f157-4fe4-ae6b-651d64087199 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:40.280232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-661acd65-f157-4fe4-ae6b-651d64087199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:40.622188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661acd65-f157-4fe4-ae6b-651d64087199 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:40.633189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5bf2b-65f2-4405-9586-8712bf8493d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:40.633959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5bf2b-65f2-4405-9586-8712bf8493d0 service glance] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:40.634315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5bf2b-65f2-4405-9586-8712bf8493d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:40.636780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5bf2b-65f2-4405-9586-8712bf8493d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:40.668117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5bf2b-65f2-4405-9586-8712bf8493d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:40.672066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5bf2b-65f2-4405-9586-8712bf8493d0 service glance] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:40.719495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 838/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:42.211193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb83cc-4991-4559-afb1-ecea1865551e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:42.211704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb83cc-4991-4559-afb1-ecea1865551e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:42.211704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb83cc-4991-4559-afb1-ecea1865551e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:42.213207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 823/1661] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 00:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:15:42.220014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:42.220895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:42.221775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:42.278035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:42.279488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:42.300546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb83cc-4991-4559-afb1-ecea1865551e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:42.302416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-04bb83cc-4991-4559-afb1-ecea1865551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:42.344247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:42.371735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 839/1662] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:15:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:42.399531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:42.401230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:42.413922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b4de3-0a88-4cd6-9c76-a312a0c3ac54 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:42.418670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7ebd1b-36bc-4a4c-a5e2-b52bad49b125 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:42.419412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ebd1b-36bc-4a4c-a5e2-b52bad49b125 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:42.419791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ebd1b-36bc-4a4c-a5e2-b52bad49b125 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:42.420162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7ebd1b-36bc-4a4c-a5e2-b52bad49b125 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:42.423847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb83cc-4991-4559-afb1-ecea1865551e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:42.430534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:42.434105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:42.434583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:42.435188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] PATH_INFO: `/v3/projects/b6e0f362acd74dfea91bbfd3dfeb1dc8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:42.436646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e0f362acd74dfea91bbfd3dfeb1dc8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:42.437880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: WARNING py.warnings [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:15:42.437880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: warnings.warn(msg) Aug 30 00:15:42.437880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: Aug 30 00:15:42.439401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:42.443922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ebd1b-36bc-4a4c-a5e2-b52bad49b125 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:42.446052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7ebd1b-36bc-4a4c-a5e2-b52bad49b125 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:42.477478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 840/1663] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:15:42.564483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e0f362acd74dfea91bbfd3dfeb1dc8', 'request_id': 'req-0843ca17-573c-49af-9c1b-325f2cbfc7a4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:42.600820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e0f362acd74dfea91bbfd3dfeb1dc8', 'request_id': 'req-0843ca17-573c-49af-9c1b-325f2cbfc7a4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:42.631801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e0f362acd74dfea91bbfd3dfeb1dc8', 'request_id': 'req-0843ca17-573c-49af-9c1b-325f2cbfc7a4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:42.658737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] The token cache is being invalidate because project b6e0f362acd74dfea91bbfd3dfeb1dc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:15:42.659030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:42.659726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0843ca17-573c-49af-9c1b-325f2cbfc7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:42.662209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 824/1664] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:15:42 2022] DELETE /identity/v3/projects/b6e0f362acd74dfea91bbfd3dfeb1dc8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:15:42.667250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:42.667753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:42.668327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:42.707452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:42.708873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:42.830104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:42.891764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 841/1665] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:42.894018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:42.894313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:42.894819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:42.943121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:42.945264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:42.961478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 825/1666] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:42.962782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:42.984034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53d740-5e04-4d87-b150-05b3848ba06d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:42.999126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.000045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.000490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.001041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.004917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:43.005482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.010848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f89a5-fb64-490f-bbad-09fef9268eb8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.042150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 842/1667] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:43.045618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.062033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b357b4-65c9-4119-94b7-900899f5728b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:43.072860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.073310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.073764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.076091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.077330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.077762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.078135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.078991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.081490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.147824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 826/1668] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:43 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:43.152063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.153095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] MFA Rules not processed for user `d8e6d4ffefda4a2ea7ac2ab7b61158e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:43.154537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:43.308045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7d103-5ae4-4e9f-9b92-1978cd519d14 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:43.318591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.319529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.320172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.320646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.322048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.324721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 843/1669] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:43.325495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.340610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.342163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:43.406344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 827/1670] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:43 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:15:43.408428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.452178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcfe69-524e-4cd4-9c6b-75ad6a593f6b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:43.476374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.479313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.479605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.483797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.484967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.491171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.507929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:43.526661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 828/1671] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:43.529079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.555351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf99c8-7c3c-4728-8fcf-3aebe70f19df admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:43.563757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.564638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.565368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.565867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.567636 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.575219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.587860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe2ca1-54a0-4aad-9479-4855def80628 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:43.624233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d1ab14-d3f6-4a25-a843-d6a203953e57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.624704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 829/1672] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:43.627659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.628742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ab14-d3f6-4a25-a843-d6a203953e57 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.629152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ab14-d3f6-4a25-a843-d6a203953e57 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.630168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d1ab14-d3f6-4a25-a843-d6a203953e57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.666923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1ab14-d3f6-4a25-a843-d6a203953e57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.672032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0178d08-f406-414e-8616-818b0de1826f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:43.680807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d1ab14-d3f6-4a25-a843-d6a203953e57 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.686227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:43.686944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.687950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.688237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] PATH_INFO: `/v3/projects/a668a97627a0490eadc979bd17f45b6e/users/dca5aa52b8b3451689107654f576ca01/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.730831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 844/1673] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:15:43.767301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a668a97627a0490eadc979bd17f45b6e, user_id=dca5aa52b8b3451689107654f576ca01, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:43.775414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:43.818336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:43.819332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:43.823046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:43.832371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 830/1674] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:43 2022] PUT /identity/v3/projects/a668a97627a0490eadc979bd17f45b6e/users/dca5aa52b8b3451689107654f576ca01/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:43.949557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] MFA Rules not processed for user `dca5aa52b8b3451689107654f576ca01`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:43.954649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:43.990374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:43.992164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:44.105576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:44.135488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ce73d-eddf-4235-abc1-356aa7269ec7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:44.151735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:44.153975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:44.154409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:44.154869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:44.160892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:44.196944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:44.198977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:44.228265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 831/1675] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:44.259908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 845/1676] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:44.264634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:44.447878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d695aae-f522-4a59-8bc3-1d217a4af9cb service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:44.466238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccf5f6-7acb-4fc3-a3ec-523f6019103b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:44.467336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf5f6-7acb-4fc3-a3ec-523f6019103b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:44.467769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf5f6-7acb-4fc3-a3ec-523f6019103b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:44.468197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccf5f6-7acb-4fc3-a3ec-523f6019103b admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:44.469262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccf5f6-7acb-4fc3-a3ec-523f6019103b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:44.471670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ccf5f6-7acb-4fc3-a3ec-523f6019103b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:44.539672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 832/1677] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:44 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:44.543775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:44.558805 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa3272-e845-4a2a-aa17-c5a8a9804cbb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:44.722091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:44.735577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:44.736325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:44.736869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:44.737883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:44.741315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:44.764164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f001aef-42c2-4bfc-808e-243af9867f33 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:44.764870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f001aef-42c2-4bfc-808e-243af9867f33 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:44.765133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f001aef-42c2-4bfc-808e-243af9867f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:44.806854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 846/1678] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:44 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:44.812513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:44.841038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2f001aef-42c2-4bfc-808e-243af9867f33 None None] MFA Rules not processed for user `0ba2a01503894fe4be71f54aff8807c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:44.842493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2f001aef-42c2-4bfc-808e-243af9867f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:44.844084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f093b77-2749-4940-bd94-cd4aa118f6b6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:44.869432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:44.870103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:44.870404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:44.870670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:44.871334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:44.872963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:44.918350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:44.949671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 847/1679] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:44.950931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:44.991639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b23570-2bf7-40e2-803d-4415e2cde4ab admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:45.018685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:45.022127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.022617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.023777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] PATH_INFO: `/v3/projects/5a2b8409f1514081a36e38049c54a6c4/users/eff52f52b86948a2b717d43aa98bcf47/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.030080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 833/1680] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:45.041251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.041486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.041978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.089172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2b8409f1514081a36e38049c54a6c4, user_id=eff52f52b86948a2b717d43aa98bcf47, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:45.091900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:45.114538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] MFA Rules not processed for user `0ba2a01503894fe4be71f54aff8807c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:45.116129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:45.130763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 848/1681] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:44 2022] PUT /identity/v3/projects/5a2b8409f1514081a36e38049c54a6c4/users/eff52f52b86948a2b717d43aa98bcf47/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:45.137095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:45.229819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 834/1682] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:45.248728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:45.333869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13117d2-0966-48e0-9628-5a5884c09430 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:45.353944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:45.354798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.356204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.356642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.357509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:45.360670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:45.376311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 849/1683] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:45.383195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:45.427610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f66f47-0d29-406a-b675-e9f55e3bb579 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:45.458295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801673a5-f7ce-4000-971e-fca3154c2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:45.459349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801673a5-f7ce-4000-971e-fca3154c2545 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.459834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801673a5-f7ce-4000-971e-fca3154c2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.460328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801673a5-f7ce-4000-971e-fca3154c2545 admin admin] PATH_INFO: `/v3/projects/5a2b8409f1514081a36e38049c54a6c4/users/eff52f52b86948a2b717d43aa98bcf47/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.466568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801673a5-f7ce-4000-971e-fca3154c2545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2b8409f1514081a36e38049c54a6c4, user_id=eff52f52b86948a2b717d43aa98bcf47, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:45.473213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cd4b7-5d2f-4802-b041-757e9823f140 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:45.476739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801673a5-f7ce-4000-971e-fca3154c2545 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:45.481723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6906-6147-41cd-b8d6-3e6311dd03aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:45.482985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6906-6147-41cd-b8d6-3e6311dd03aa service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.483285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6906-6147-41cd-b8d6-3e6311dd03aa service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.483978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6906-6147-41cd-b8d6-3e6311dd03aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.503604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf6906-6147-41cd-b8d6-3e6311dd03aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:45.517618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf6906-6147-41cd-b8d6-3e6311dd03aa service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:45.553809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 835/1684] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:45.554637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 850/1685] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:45 2022] PUT /identity/v3/projects/5a2b8409f1514081a36e38049c54a6c4/users/eff52f52b86948a2b717d43aa98bcf47/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:15:45.568154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.568841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.569288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.694055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] MFA Rules not processed for user `eff52f52b86948a2b717d43aa98bcf47`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:45.696028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:45.736024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4182e-a084-4b8a-a00e-897e33260e37 None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.736325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4182e-a084-4b8a-a00e-897e33260e37 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.736691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4182e-a084-4b8a-a00e-897e33260e37 None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.739601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 851/1686] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 00:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:15:45.753079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:45.753427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:45.754019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:45.810204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:45.830480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:45.849834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:45.852089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:45.891380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 836/1687] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:45.905266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:45.907256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:46.052573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 852/1688] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:15:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:46.068344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:46.070038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:46.109244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983618ca-1421-47b7-9e03-811ce79ba1ea None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:46.120455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:46.121322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.121793 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.122251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.159642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:46.165816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:46.204217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 837/1689] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:46.217580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ef36d-dd98-45df-8a7c-bd7769bf86aa None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:46.227692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:46.228543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.228755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.229855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.234426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:46.235937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:46.291981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:46.294638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:46.356206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 853/1690] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:15:46.357199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:46.407686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a7698-39f4-4975-bb7f-4f059139e758 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:46.414559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:46.415460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.416457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.416831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] PATH_INFO: `/v3/users/6877e6e4715547608e390733b912f5ac` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.418298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6877e6e4715547608e390733b912f5ac)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:46.421226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:46.544494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6877e6e4715547608e390733b912f5ac'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.561367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677e52a-ed9f-434d-8176-05706f0e8034 service glance] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:46.561972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6877e6e4715547608e390733b912f5ac'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.562531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6877e6e4715547608e390733b912f5ac'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.575761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6877e6e4715547608e390733b912f5ac'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.576402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c770a30c-9719-4ff2-8e19-8e20b69dfff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6877e6e4715547608e390733b912f5ac'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.585787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:46.586459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.586747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.587028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] PATH_INFO: `/v3/users/dca5aa52b8b3451689107654f576ca01` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.593990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca5aa52b8b3451689107654f576ca01)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:46.605808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: WARNING py.warnings [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 30 00:15:46.605808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: warnings.warn(msg) Aug 30 00:15:46.605808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: Aug 30 00:15:46.607182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:46.610253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 838/1691] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:15:46 2022] DELETE /identity/v3/users/6877e6e4715547608e390733b912f5ac => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:15:46.612195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1564-f391-4dbe-8cd2-cd5ec4945c69 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.612488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1564-f391-4dbe-8cd2-cd5ec4945c69 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.612764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1564-f391-4dbe-8cd2-cd5ec4945c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.632585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:46.642317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-161c1564-f391-4dbe-8cd2-cd5ec4945c69 None None] MFA Rules not processed for user `66526665148e4f1792868ce8d0c449f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:46.647418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-161c1564-f391-4dbe-8cd2-cd5ec4945c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:46.768281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 839/1692] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:46.771274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.771694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.772085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.802599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:46.809311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca5aa52b8b3451689107654f576ca01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.847291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca5aa52b8b3451689107654f576ca01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.851467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca5aa52b8b3451689107654f576ca01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.859046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:46.865072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:46.908235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca5aa52b8b3451689107654f576ca01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.930042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4fb6a3b8-52da-46c2-b25e-4029919a18eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca5aa52b8b3451689107654f576ca01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:46.942318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 854/1693] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:15:46 2022] DELETE /identity/v3/users/dca5aa52b8b3451689107654f576ca01 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:46.945899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:46.946233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:46.946524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:46.990781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:46.992185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:47.114158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 840/1694] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:47.138473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:47.140758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:47.157518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 855/1695] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:47.202957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:47.205768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:47.327817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8613b0-34df-4a34-9df3-a4ca5f4278bf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:47.389162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c23e17b-56ff-4517-ab50-8b16b04ae23e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:47.420249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3ce48-7c1a-493d-9924-04076ba1e812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:47.421352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ce48-7c1a-493d-9924-04076ba1e812 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:47.422012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ce48-7c1a-493d-9924-04076ba1e812 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:47.423472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3ce48-7c1a-493d-9924-04076ba1e812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:47.448322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ce48-7c1a-493d-9924-04076ba1e812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:47.454325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e3ce48-7c1a-493d-9924-04076ba1e812 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:47.498230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 856/1696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:15:47.602724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e39a0-b60a-4c80-a4c5-a0e6cbe637d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:47.603392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e39a0-b60a-4c80-a4c5-a0e6cbe637d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:47.604958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e39a0-b60a-4c80-a4c5-a0e6cbe637d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:47.605399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e39a0-b60a-4c80-a4c5-a0e6cbe637d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:47.640311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e39a0-b60a-4c80-a4c5-a0e6cbe637d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:47.654077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e39a0-b60a-4c80-a4c5-a0e6cbe637d9 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:47.691594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 841/1697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:15:47.789013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b48a-fc5d-4012-80e6-98213965819e None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:47.789522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b48a-fc5d-4012-80e6-98213965819e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:47.789872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1b48a-fc5d-4012-80e6-98213965819e None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:47.793159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 857/1698] 10.222.0.43 () {54 vars in 912 bytes} [Tue Aug 30 00:15:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:15:47.798854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055555e1-fde0-42fd-b9d7-40442c54eaa8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:47.799456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055555e1-fde0-42fd-b9d7-40442c54eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:47.800001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055555e1-fde0-42fd-b9d7-40442c54eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:47.839261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-055555e1-fde0-42fd-b9d7-40442c54eaa8 None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:47.840506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-055555e1-fde0-42fd-b9d7-40442c54eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:47.866477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 842/1699] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:15:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:47.909286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b48a-fc5d-4012-80e6-98213965819e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:47.933431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1b48a-fc5d-4012-80e6-98213965819e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:47.946488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaaa6d3-6927-45f1-9d41-d24bf2b8331b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:47.949244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa6d3-6927-45f1-9d41-d24bf2b8331b service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:47.951947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa6d3-6927-45f1-9d41-d24bf2b8331b service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:47.952887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaaa6d3-6927-45f1-9d41-d24bf2b8331b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:47.985546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa6d3-6927-45f1-9d41-d24bf2b8331b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:47.992810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaaa6d3-6927-45f1-9d41-d24bf2b8331b service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:48.026740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 858/1700] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:48.219314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9594-fb1c-4dfd-a123-4261630c0022 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:48.219604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9594-fb1c-4dfd-a123-4261630c0022 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:48.219879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d9594-fb1c-4dfd-a123-4261630c0022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:48.229877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:48.278998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-844d9594-fb1c-4dfd-a123-4261630c0022 None None] MFA Rules not processed for user `ea5524cca92f42c3841e74995edee832`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:48.280296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-844d9594-fb1c-4dfd-a123-4261630c0022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:48.361306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:48.361306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:48.361306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:48.436438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 843/1701] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:48.447050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:48.447662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:48.448117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:48.512903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] MFA Rules not processed for user `ea5524cca92f42c3841e74995edee832`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:48.517641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:48.533329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 844/1702] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:48.542816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:48.544572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:48.622100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:48.735807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 859/1703] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:15:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:48.887727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:48.889204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:48.926200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac63db-8002-456b-9a44-8eeaa0ce15be None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:48.933830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:48.934488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:48.935466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:48.935752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] PATH_INFO: `/v3/projects/cc3fc5b9a859442180700cbeb69d9fc8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:48.937950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3fc5b9a859442180700cbeb69d9fc8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:48.942766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:48.991001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:48.992954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:49.057064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3fc5b9a859442180700cbeb69d9fc8', 'request_id': 'req-7b25fe35-52f2-4ee1-a857-936a3234992c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.072683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3fc5b9a859442180700cbeb69d9fc8', 'request_id': 'req-7b25fe35-52f2-4ee1-a857-936a3234992c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.085013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3fc5b9a859442180700cbeb69d9fc8', 'request_id': 'req-7b25fe35-52f2-4ee1-a857-936a3234992c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.119543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] The token cache is being invalidate because project cc3fc5b9a859442180700cbeb69d9fc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:15:49.119543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.121948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.126784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 845/1704] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:15:48 2022] DELETE /identity/v3/projects/cc3fc5b9a859442180700cbeb69d9fc8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:49.126784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:49.133956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:49.313372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efda50c5-eb60-44a1-a232-d29d053a5454 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:49.386835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25fe35-52f2-4ee1-a857-936a3234992c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:49.435722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:49.443440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:49.445968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:49.446834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] PATH_INFO: `/v3/projects/a668a97627a0490eadc979bd17f45b6e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:49.460521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a668a97627a0490eadc979bd17f45b6e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:49.464855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:49.516317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:49.516970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:49.517259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:49.517892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:49.521780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:49.543624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:49.667471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:49.692789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a668a97627a0490eadc979bd17f45b6e', 'request_id': 'req-3975d264-68b2-4555-8775-b29f8b8a3c64'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.717085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:49.718738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:49.726767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a668a97627a0490eadc979bd17f45b6e', 'request_id': 'req-3975d264-68b2-4555-8775-b29f8b8a3c64'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.737547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a668a97627a0490eadc979bd17f45b6e', 'request_id': 'req-3975d264-68b2-4555-8775-b29f8b8a3c64'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.762225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 860/1705] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:15:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:15:49.764875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:49.772984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:49.777420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] The token cache is being invalidate because project a668a97627a0490eadc979bd17f45b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:15:49.779196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.780585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3975d264-68b2-4555-8775-b29f8b8a3c64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:49.792671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 846/1706] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:15:49 2022] DELETE /identity/v3/projects/a668a97627a0490eadc979bd17f45b6e => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:49.792671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:49.792671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:49.792671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:49.904855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888c1fc-fd86-4f04-a065-e949603f0f73 service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:50.031341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] MFA Rules not processed for user `d8e6d4ffefda4a2ea7ac2ab7b61158e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:50.038788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:50.095983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:50.098413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:50.098855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:50.099137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] PATH_INFO: `/v3/users/0d6c2076562e46d496b419fa4d6fb266` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:50.101591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d6c2076562e46d496b419fa4d6fb266)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:50.103616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:50.255440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d6c2076562e46d496b419fa4d6fb266'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.261254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 847/1707] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:50.266367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:50.279968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:50.287145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d6c2076562e46d496b419fa4d6fb266'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.288319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d6c2076562e46d496b419fa4d6fb266'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.346652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bac3fa-a399-4e87-b4ee-5b8d94ba4663 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:50.362291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:50.363184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:50.363483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:50.363768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] PATH_INFO: `/v3/users/eff52f52b86948a2b717d43aa98bcf47` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:50.365318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff52f52b86948a2b717d43aa98bcf47)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:50.370960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d6c2076562e46d496b419fa4d6fb266'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.383821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:50.400876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d6c2076562e46d496b419fa4d6fb266'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.422958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 861/1708] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:15:49 2022] DELETE /identity/v3/users/0d6c2076562e46d496b419fa4d6fb266 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:50.424293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:50.426323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:50.533246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:50.542963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d98e4f-cba9-44c5-9c94-d48fb0b43cac admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:50.574028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:50.577260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:50.579655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:50.580488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:50.590292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:50.609030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff52f52b86948a2b717d43aa98bcf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.646681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff52f52b86948a2b717d43aa98bcf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.650878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff52f52b86948a2b717d43aa98bcf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.684162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff52f52b86948a2b717d43aa98bcf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.686163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff52f52b86948a2b717d43aa98bcf47'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:50.810923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 848/1709] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:15:50 2022] DELETE /identity/v3/users/eff52f52b86948a2b717d43aa98bcf47 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:50.916658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:50.920931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bbf42-ef3f-41f7-aa32-85eaf75a2480 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:50.957777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 862/1710] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:51.696656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:51.698759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:51.837951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:52.143529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbe03a-1dee-45ab-815d-47dff0898eae admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:52.166036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:52.166744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:52.174027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:52.174618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] PATH_INFO: `/v3/projects/f7a27d5d4b2f41b2a616e6a6d6b977a0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:52.186044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a27d5d4b2f41b2a616e6a6d6b977a0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:52.188812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:52.353967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a27d5d4b2f41b2a616e6a6d6b977a0', 'request_id': 'req-e8af5592-29d4-4424-af57-e06de9df5a2f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:52.368532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a27d5d4b2f41b2a616e6a6d6b977a0', 'request_id': 'req-e8af5592-29d4-4424-af57-e06de9df5a2f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:52.377187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a27d5d4b2f41b2a616e6a6d6b977a0', 'request_id': 'req-e8af5592-29d4-4424-af57-e06de9df5a2f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:52.411145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] The token cache is being invalidate because project f7a27d5d4b2f41b2a616e6a6d6b977a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:15:52.411509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:52.421956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e8af5592-29d4-4424-af57-e06de9df5a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:52.431333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 849/1711] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:15:51 2022] DELETE /identity/v3/projects/f7a27d5d4b2f41b2a616e6a6d6b977a0 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:52.433197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:52.433733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:52.433824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:52.496312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:52.501829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:52.703463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 863/1712] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:52.713673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:52.714599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:52.715032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:52.751237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:52.752689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:52.773292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 850/1713] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:52.777775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:52.798412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878fe4e-fe28-4076-8ad3-8c192b1fb08c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:52.822787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:52.829217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:52.830187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:52.830495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:52.835279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:52.835634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:52.841466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:52.892276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 864/1714] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:52.896097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:52.909646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cf477-e999-4b83-ad79-c81cb83f72a1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:52.922469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:52.923103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:52.923320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:52.923822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:52.925682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:52.928059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:53.011647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 851/1715] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:52 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:53.014052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:53.050473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2613b6-cbc2-433c-a749-af8e9464afb1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:53.205442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:53.206053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:53.206331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:53.207411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:53.208204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:53.210229 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:53.251395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 865/1716] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:53 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:53.255153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:53.270810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f4071-35fa-4401-927e-c0ab7b9f0713 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:53.281695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:53.282345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:53.282627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:53.282897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:53.283564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:53.294854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:53.309046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 852/1717] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:53.315005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:53.330900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a01763-fed4-4e25-96f2-a0b20fb97ff3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:53.341330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10620f4-a0cb-4599-8e78-35ee0cc8943a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:53.342053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10620f4-a0cb-4599-8e78-35ee0cc8943a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:53.342337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10620f4-a0cb-4599-8e78-35ee0cc8943a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:53.342612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10620f4-a0cb-4599-8e78-35ee0cc8943a admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:53.343403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10620f4-a0cb-4599-8e78-35ee0cc8943a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:53.350992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10620f4-a0cb-4599-8e78-35ee0cc8943a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:53.372663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:53.383424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 866/1718] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:53.387717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d978e-f2f3-4742-954b-0198100e356c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:53.400039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:53.400721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:53.401007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:53.401438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] PATH_INFO: `/v3/projects/3a9a878a22b64f9887c03ff8b597a0cf/users/91082cf748e84f638e4dcec340dfbc6f/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:53.439289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9a878a22b64f9887c03ff8b597a0cf, user_id=91082cf748e84f638e4dcec340dfbc6f, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:53.442020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:53.466775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 853/1719] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:53 2022] PUT /identity/v3/projects/3a9a878a22b64f9887c03ff8b597a0cf/users/91082cf748e84f638e4dcec340dfbc6f/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:15:53.487825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:53.489081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:53.489215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:53.534135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:53.556681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] MFA Rules not processed for user `91082cf748e84f638e4dcec340dfbc6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:53.559367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:53.780485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 867/1720] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:53.781029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:53.920904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:53.923052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:53.962400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:54.005970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2206e4c-ae5c-4df2-8a81-cef7083b48cf admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:54.019056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:54.022487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:54.023191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:54.023722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:54.024556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:54.029784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:54.080450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 854/1721] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:53 2022] POST /identity/v3/projects => generated 375 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:15:54.084912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:54.099980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bb3f05-4aaa-4c33-9dac-463efa49ea9c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:54.246870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:54.247765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:54.248130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:54.248653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] PATH_INFO: `/v3/projects/5a2b8409f1514081a36e38049c54a6c4` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:54.256343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2b8409f1514081a36e38049c54a6c4)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:54.260461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:54.392146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:54.394792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2b8409f1514081a36e38049c54a6c4', 'request_id': 'req-3aa3374d-14c3-43c5-95ca-9baaa23ae948'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:54.432307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2b8409f1514081a36e38049c54a6c4', 'request_id': 'req-3aa3374d-14c3-43c5-95ca-9baaa23ae948'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:54.464373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2b8409f1514081a36e38049c54a6c4', 'request_id': 'req-3aa3374d-14c3-43c5-95ca-9baaa23ae948'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:54.501220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca574f-07ea-4945-8df0-7017976ce91a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:54.515594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] The token cache is being invalidate because project 5a2b8409f1514081a36e38049c54a6c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:15:54.517339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:54.520078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3aa3374d-14c3-43c5-95ca-9baaa23ae948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:15:54.527515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 868/1722] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:15:53 2022] DELETE /identity/v3/projects/5a2b8409f1514081a36e38049c54a6c4 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:54.537478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a577a-79fa-404d-a275-b510d828263e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:54.538884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a577a-79fa-404d-a275-b510d828263e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:54.539912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a577a-79fa-404d-a275-b510d828263e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:54.585966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8c2a577a-79fa-404d-a275-b510d828263e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:54.588811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8c2a577a-79fa-404d-a275-b510d828263e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:54.982819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 869/1723] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:55.002810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.002810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.002810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.064426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52402baf-81b3-46d7-b02d-00db6ddf0f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:55.065200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52402baf-81b3-46d7-b02d-00db6ddf0f4d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.065386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52402baf-81b3-46d7-b02d-00db6ddf0f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.065664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52402baf-81b3-46d7-b02d-00db6ddf0f4d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.066758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52402baf-81b3-46d7-b02d-00db6ddf0f4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:55.088883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52402baf-81b3-46d7-b02d-00db6ddf0f4d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:55.190017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:55.195667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:55.247652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 855/1724] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:54 2022] POST /identity/v3/users => generated 294 bytes in 1163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:15:55.252737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.253800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.261664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.345858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:55.347083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:55.386516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 856/1725] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:55.393113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:55.396903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:55.438006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 870/1726] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Aug 30 00:15:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:55.438973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:55.449671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d88c805-5546-4358-9108-c778d2aaa620 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:55.469738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:55.470362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.470650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.476044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.476693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:55.486929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:55.492648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa9107-2abd-4249-b2e4-c6b560a137bb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:55.530941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:55.536098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.536425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.536695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.542892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:15:55.546651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:55.555008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:55.563495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 857/1727] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:55.568434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:55.617504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ac170b-cb85-4b00-a2a7-6fad381dac0d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:55.618602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 871/1728] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:15:55.621408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:55.633411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:55.634128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.638099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.639332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] PATH_INFO: `/v3/projects/18097ab85a8a42f7ba9fb3de5883d4d0/users/b0bca09ba91c4f0e87894f40954b51e1/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.667032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933191e-d53b-4296-bed3-77248a8b9934 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:55.710167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:55.710821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:55.711108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:55.712844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:55.724246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:55.732128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:55.742929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18097ab85a8a42f7ba9fb3de5883d4d0, user_id=b0bca09ba91c4f0e87894f40954b51e1, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:55.753501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:55.805221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 858/1729] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:55 2022] PUT /identity/v3/projects/18097ab85a8a42f7ba9fb3de5883d4d0/users/b0bca09ba91c4f0e87894f40954b51e1/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:55.807427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:55.812144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:55.871932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 872/1730] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:55 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:55.875442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:55.910830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:55.997985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df48bad8-00ce-4ae9-afaa-0a4ec2c47fc5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.044484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:56.085144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19799a97-6159-436f-b224-75e5cdffa8db admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.119046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.120985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.123227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.127618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.128505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.131655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.178086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 873/1731] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:56.179427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:56.196138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.198444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.199246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.199945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.205926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd65e1c-4d1e-48ff-af0d-9fa7844c635e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.225129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.226814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.227717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.228947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.230054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.230921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.231832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.237124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.261958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 859/1732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:56.264074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:56.310089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2e904a-641f-4544-9432-755a54d937d1 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.314038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 874/1733] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:56 2022] POST /identity/v3/users => generated 289 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:56.316268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:56.337159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c6f7d-8fc0-48cc-92fe-9a3f6ab1e747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.339867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c6f7d-8fc0-48cc-92fe-9a3f6ab1e747 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.341475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c6f7d-8fc0-48cc-92fe-9a3f6ab1e747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.342852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c6f7d-8fc0-48cc-92fe-9a3f6ab1e747 admin admin] PATH_INFO: `/v3/projects/18097ab85a8a42f7ba9fb3de5883d4d0/users/b0bca09ba91c4f0e87894f40954b51e1/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.363486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c6f7d-8fc0-48cc-92fe-9a3f6ab1e747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18097ab85a8a42f7ba9fb3de5883d4d0, user_id=b0bca09ba91c4f0e87894f40954b51e1, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.377040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c6f7d-8fc0-48cc-92fe-9a3f6ab1e747 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.385429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e36259-27ec-4ba2-9c26-56e43cf9fdb8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.411632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.412283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.412561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.412830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.415932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.417583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.446156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 860/1734] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:56 2022] PUT /identity/v3/projects/18097ab85a8a42f7ba9fb3de5883d4d0/users/b0bca09ba91c4f0e87894f40954b51e1/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:56.459543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.460008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.460402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.472934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 875/1735] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:56.477358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:56.516304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51c02b-3170-4e2c-b5ce-1633ca4c12d3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.632744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] MFA Rules not processed for user `b0bca09ba91c4f0e87894f40954b51e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:56.634442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:56.699644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.700608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.700608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.700880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.701549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.705474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.762307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 876/1736] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:56.764598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:56.793993 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850562b2-1cba-4423-b3fa-79b905fa7851 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:56.807392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dbf7dd-d4fc-468a-bb20-d2b42679310d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:56.808092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf7dd-d4fc-468a-bb20-d2b42679310d admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.808377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf7dd-d4fc-468a-bb20-d2b42679310d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.808746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dbf7dd-d4fc-468a-bb20-d2b42679310d admin admin] PATH_INFO: `/v3/projects/67eecbac7cb94fd0a097dede98f729b5/users/d3ececb0115d488bbc586e781211fa69/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.830703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf7dd-d4fc-468a-bb20-d2b42679310d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67eecbac7cb94fd0a097dede98f729b5, user_id=d3ececb0115d488bbc586e781211fa69, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:56.835461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dbf7dd-d4fc-468a-bb20-d2b42679310d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:56.889570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 877/1737] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:56 2022] PUT /identity/v3/projects/67eecbac7cb94fd0a097dede98f729b5/users/d3ececb0115d488bbc586e781211fa69/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:56.901516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fa445-b79f-411c-92fd-96edb710931e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:56.902024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fa445-b79f-411c-92fd-96edb710931e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:56.902495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fa445-b79f-411c-92fd-96edb710931e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:56.934320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 861/1738] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 476 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:56.947305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:56.950593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:57.055429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-350fa445-b79f-411c-92fd-96edb710931e None None] MFA Rules not processed for user `d3ececb0115d488bbc586e781211fa69`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:57.056696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-350fa445-b79f-411c-92fd-96edb710931e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:57.117611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b04a1-01a8-41f6-8a5e-d5ef66e7394a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:57.147988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:57.258511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 878/1739] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:15:57.262353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fa445-b79f-411c-92fd-96edb710931e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:57.309678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:57.310978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:57.312070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:57.313065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:57.321281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:57.365743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:57.543141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fa445-b79f-411c-92fd-96edb710931e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:57.553913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:57.558516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:57.568512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:57.570044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:57.570352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:57.570731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:57.571397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:57.581753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:57.585562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 862/1740] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:15:57.667394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 879/1741] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:15:57 2022] POST /identity/v3/projects => generated 379 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:15:57.668722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:57.686555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ac472-3d1a-4b6c-8ba0-0f5f6e12d18b service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:57.902854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8726a8-cd06-47bb-afc8-4dacb5bab805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:57.904629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8726a8-cd06-47bb-afc8-4dacb5bab805 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:57.904935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8726a8-cd06-47bb-afc8-4dacb5bab805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:57.905214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8726a8-cd06-47bb-afc8-4dacb5bab805 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:57.905889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8726a8-cd06-47bb-afc8-4dacb5bab805 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:57.910558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8726a8-cd06-47bb-afc8-4dacb5bab805 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:57.970555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 863/1742] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:15:57 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:15:57.974929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:57.996684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:57.997026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:57.997245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:57.998720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e9539-da6a-4c4d-9ca2-54afbe4d88f3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:58.006179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:58.007092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:58.009224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:58.009633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:58.010655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:58.012535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:58.068131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] MFA Rules not processed for user `ea5524cca92f42c3841e74995edee832`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:58.069373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:58.094261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 880/1743] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:58.095538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:58.143870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283bde4c-801b-469e-90c6-939a0616aab4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:58.164983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:58.166430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:58.168790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:58.168950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] PATH_INFO: `/v3/projects/1fc174f947b94fe3ae21976ea7461855/users/96a65ebfb02642e6981ec378a09ed00a/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:58.226197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc174f947b94fe3ae21976ea7461855, user_id=96a65ebfb02642e6981ec378a09ed00a, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:58.241322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:58.297740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 881/1744] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:58 2022] PUT /identity/v3/projects/1fc174f947b94fe3ae21976ea7461855/users/96a65ebfb02642e6981ec378a09ed00a/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:58.304923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:58.318200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:58.358952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 864/1745] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:58.564593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41adc62-865e-4c53-869f-7cf868267dac admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:58.596366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b72c34d-db60-4d5d-81c7-27ec72b16f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:58.597079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c34d-db60-4d5d-81c7-27ec72b16f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:58.597365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c34d-db60-4d5d-81c7-27ec72b16f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:58.598440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b72c34d-db60-4d5d-81c7-27ec72b16f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:58.599192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c34d-db60-4d5d-81c7-27ec72b16f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:58.600816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b72c34d-db60-4d5d-81c7-27ec72b16f6f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:58.652903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 882/1746] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:15:58 2022] GET /identity/v3/roles => generated 1420 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:15:58.657738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:58.697444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021bd2ee-2bb4-4896-8b69-7325c065dbd6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:58.729351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:58.734607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:58.740513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:58.742770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] PATH_INFO: `/v3/projects/1fc174f947b94fe3ae21976ea7461855/users/96a65ebfb02642e6981ec378a09ed00a/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:58.748184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fc174f947b94fe3ae21976ea7461855, user_id=96a65ebfb02642e6981ec378a09ed00a, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:58.766469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:58.868041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 865/1747] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:15:58 2022] PUT /identity/v3/projects/1fc174f947b94fe3ae21976ea7461855/users/96a65ebfb02642e6981ec378a09ed00a/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:15:58.870037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:58.870335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:58.870691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:58.932919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] MFA Rules not processed for user `96a65ebfb02642e6981ec378a09ed00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:15:58.934222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:15:59.106115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:15:59.193798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 883/1748] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:15:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:15:59.209336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:15:59.420896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98990e-72e7-4d1f-afba-70907b24174b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:15:59.428016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7588a35-5a6f-4084-856f-4955703c7fee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:15:59.428662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588a35-5a6f-4084-856f-4955703c7fee service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:15:59.428955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588a35-5a6f-4084-856f-4955703c7fee service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:15:59.429246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7588a35-5a6f-4084-856f-4955703c7fee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:15:59.624045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588a35-5a6f-4084-856f-4955703c7fee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:15:59.625690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7588a35-5a6f-4084-856f-4955703c7fee service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:15:59.663042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 866/1749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:15:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:01.854675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:01.868241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e8f22-f7be-4d26-852c-2ab544170396 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:01.873947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e69d26-b4b4-471a-82b1-6382374c7f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:01.882709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e69d26-b4b4-471a-82b1-6382374c7f5c service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:01.883402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e69d26-b4b4-471a-82b1-6382374c7f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:01.883808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e69d26-b4b4-471a-82b1-6382374c7f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:01.906176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e69d26-b4b4-471a-82b1-6382374c7f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:01.907783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e69d26-b4b4-471a-82b1-6382374c7f5c service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:01.976514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 884/1750] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:02.231463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d946-7c6c-4326-b590-5d00f2ea32a3 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:02.234540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d946-7c6c-4326-b590-5d00f2ea32a3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:02.235872 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2d946-7c6c-4326-b590-5d00f2ea32a3 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:02.239547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 867/1751] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:16:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:16:02.318795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:02.319215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:02.319573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:02.343313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d946-7c6c-4326-b590-5d00f2ea32a3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:02.373754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2d946-7c6c-4326-b590-5d00f2ea32a3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:02.388854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:02.390034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6d3373-9b95-498d-9543-3ed2aab4217b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:02.391245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3373-9b95-498d-9543-3ed2aab4217b service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:02.393347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:02.397227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3373-9b95-498d-9543-3ed2aab4217b service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:02.397762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d3373-9b95-498d-9543-3ed2aab4217b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:02.622843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d3373-9b95-498d-9543-3ed2aab4217b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:02.624773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6d3373-9b95-498d-9543-3ed2aab4217b service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:02.667176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 885/1752] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:16:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:02.670316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 868/1753] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:03.619386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:03.621510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:03.866539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5f286-ba95-48bd-8a4d-1dd4999442bb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:03.882617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:03.887878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:03.888551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:03.888997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] PATH_INFO: `/v3/users/871e8a8e1baa48fb9923e12562921a50` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:03.891691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871e8a8e1baa48fb9923e12562921a50)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:03.894999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:04.026059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871e8a8e1baa48fb9923e12562921a50'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:04.046233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871e8a8e1baa48fb9923e12562921a50'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:04.047676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871e8a8e1baa48fb9923e12562921a50'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:04.066089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:04.069694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871e8a8e1baa48fb9923e12562921a50'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:04.084748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871e8a8e1baa48fb9923e12562921a50'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:04.095279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 886/1754] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:03 2022] DELETE /identity/v3/users/871e8a8e1baa48fb9923e12562921a50 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:04.100189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101aa4-ed84-4856-92d0-fd2e240820cb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:04.101244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101aa4-ed84-4856-92d0-fd2e240820cb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:04.101690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101aa4-ed84-4856-92d0-fd2e240820cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:04.159564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-cb101aa4-ed84-4856-92d0-fd2e240820cb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:04.161757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cb101aa4-ed84-4856-92d0-fd2e240820cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:04.237752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:04.333773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 869/1755] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:04.400735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:04.403022 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:04.619986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c2ecc-818a-4694-b445-a09f9fb158b1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:04.646419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:04.649795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:04.650159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:04.650468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:04.702965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:04.709184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:04.758380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 887/1756] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:05.290285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d8bc0-0c21-47da-a2be-6e205fef0213 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:05.290906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d8bc0-0c21-47da-a2be-6e205fef0213 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:05.290906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d8bc0-0c21-47da-a2be-6e205fef0213 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:05.292453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 870/1757] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:16:05.474915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:05.480883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:05.489532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:05.490503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:05.490931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:05.554674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:05.560149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:05.698761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedf27f-89e9-475e-9aeb-e767fcaa7af5 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:05.716433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:05.717077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:05.717359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:05.717853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:05.721042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:05.738783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:05.741691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:05.777786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 871/1758] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:16:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:05.781656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 888/1759] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:06.475635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:06.489153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899f61-2fa1-4775-ab5c-1e1afcc75ed1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:06.495914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:06.496628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:06.496975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:06.497404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:06.500859 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:06.502323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:06.517334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:06.519269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e7ca88-1be6-4e51-a072-512a228f78cc service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:06.520564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:06.525504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:06.526167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:06.526447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:06.526718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] PATH_INFO: `/v3/projects/3f24978c195d4fc9a31c33c6408c9b8b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:06.527924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f24978c195d4fc9a31c33c6408c9b8b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:06.529868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:06.549017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 872/1760] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:06.594543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f24978c195d4fc9a31c33c6408c9b8b', 'request_id': 'req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.606532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f24978c195d4fc9a31c33c6408c9b8b', 'request_id': 'req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.617183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f24978c195d4fc9a31c33c6408c9b8b', 'request_id': 'req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.630984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:06.637139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] The token cache is being invalidate because project 3f24978c195d4fc9a31c33c6408c9b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:06.637650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.639028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.641016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 889/1761] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:06 2022] DELETE /identity/v3/projects/3f24978c195d4fc9a31c33c6408c9b8b => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:06.645213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:06.656500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53daf4-2671-48a0-bccf-1dbc5869e0f3 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:06.716226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:06.716777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:06.717058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:06.717331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] PATH_INFO: `/v3/users/8bd9ac625a1f4bb491b35e3628258cfb` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:06.718542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd9ac625a1f4bb491b35e3628258cfb)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:06.720466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:06.776584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd9ac625a1f4bb491b35e3628258cfb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.784020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd9ac625a1f4bb491b35e3628258cfb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.784715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd9ac625a1f4bb491b35e3628258cfb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.787171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:06.795171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd9ac625a1f4bb491b35e3628258cfb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.795889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bf73079b-66cf-4359-9826-efbd87028074 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd9ac625a1f4bb491b35e3628258cfb'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:06.814735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 873/1762] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:06 2022] DELETE /identity/v3/users/8bd9ac625a1f4bb491b35e3628258cfb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:06.910861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:06.913940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:06.932460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a4af-8df7-4ed4-8c07-7ca4e510f4d4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:07.012070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:07.013311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.013478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.014102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] PATH_INFO: `/v3/users/d3ececb0115d488bbc586e781211fa69` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.016269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3ececb0115d488bbc586e781211fa69)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:07.019399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:07.082592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3ececb0115d488bbc586e781211fa69'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.091071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3ececb0115d488bbc586e781211fa69'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.091829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3ececb0115d488bbc586e781211fa69'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.108192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3ececb0115d488bbc586e781211fa69'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.119538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3ececb0115d488bbc586e781211fa69'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.128319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 890/1763] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:06 2022] DELETE /identity/v3/users/d3ececb0115d488bbc586e781211fa69 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:07.133103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.133394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.133674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.148801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:07.150423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:07.156340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:07.157533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:07.238076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 874/1764] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:07.241284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c0ace-fbe8-48b6-a5b5-b9f6d0d2a334 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:07.246782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:07.247533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.247883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.248226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] PATH_INFO: `/v3/projects/cb9308eb7ca6491982fa3d8a7d087921` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.249580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:07.251602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:07.253521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9308eb7ca6491982fa3d8a7d087921)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:07.257968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:07.308671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:07.350048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44158226-8630-4385-b44d-cc744e0d1208 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:07.387306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9308eb7ca6491982fa3d8a7d087921', 'request_id': 'req-1a1d6d6c-4dd1-41df-ba39-05470229146f'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.402896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9308eb7ca6491982fa3d8a7d087921', 'request_id': 'req-1a1d6d6c-4dd1-41df-ba39-05470229146f'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.410865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9308eb7ca6491982fa3d8a7d087921', 'request_id': 'req-1a1d6d6c-4dd1-41df-ba39-05470229146f'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.431202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9905d2-c14f-4413-b6ef-ecc99c942e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:07.432485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9905d2-c14f-4413-b6ef-ecc99c942e3a service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.432788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9905d2-c14f-4413-b6ef-ecc99c942e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.433932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9905d2-c14f-4413-b6ef-ecc99c942e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.451248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] The token cache is being invalidate because project cb9308eb7ca6491982fa3d8a7d087921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:07.451550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.460524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-1a1d6d6c-4dd1-41df-ba39-05470229146f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:07.467510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 891/1765] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:07 2022] DELETE /identity/v3/projects/cb9308eb7ca6491982fa3d8a7d087921 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:07.477270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.477270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.477270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.526393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:07.527984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:07.585417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:07.625522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9905d2-c14f-4413-b6ef-ecc99c942e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:07.627015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9905d2-c14f-4413-b6ef-ecc99c942e3a service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:07.643744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 875/1766] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:07.657666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 892/1767] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:07.666401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.666401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.666702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.695830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:07.697069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:07.705690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 876/1768] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:07.710439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:07.720449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfca020a-993f-49d1-bfb6-49789964142d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:07.726839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:07.727463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.727752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.728027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.728692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:07.729004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:07.730647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:07.743027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 893/1769] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:07.748662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:07.759198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834a9bc-64f4-4fb9-930f-d5c5d03527e9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:07.767648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:07.768697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.781927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.782669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.783496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:07.786999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:07.821128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 877/1770] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:07 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:07.826602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:07.859425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de3c79-3889-49d8-aa2e-2848577d2bcb admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:07.954033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:07.954737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:07.955087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:07.955449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:07.956228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:07.958595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.004297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.015747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 894/1771] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:07 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:08.018538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe960351-5140-4e07-b511-8f272e8fe9a6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.024572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.025278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.027273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.027623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.028435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.030172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.060852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 878/1772] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:08.064920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.081330 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ef2ce-cde7-4be7-a2b2-70324c514990 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.096387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376231c-4412-4506-86c5-939ec17e0dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.097157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376231c-4412-4506-86c5-939ec17e0dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.098114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376231c-4412-4506-86c5-939ec17e0dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.098496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376231c-4412-4506-86c5-939ec17e0dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.099275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376231c-4412-4506-86c5-939ec17e0dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.101249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376231c-4412-4506-86c5-939ec17e0dd8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.132584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 895/1773] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:08.136616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.151618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b18e12-8964-41fa-8e4d-6afdd2e7f984 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.166912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.167648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.167939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.168216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] PATH_INFO: `/v3/projects/08e2747f84704b808be50fd512e1a33c/users/2eece2ff476049f5bead23d67f3e861d/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.186304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e2747f84704b808be50fd512e1a33c, user_id=2eece2ff476049f5bead23d67f3e861d, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.188998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.206083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 879/1774] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:08 2022] PUT /identity/v3/projects/08e2747f84704b808be50fd512e1a33c/users/2eece2ff476049f5bead23d67f3e861d/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:08.217076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.217529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.217839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.255284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] MFA Rules not processed for user `2eece2ff476049f5bead23d67f3e861d`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:08.257534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:08.263249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:08.358026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 896/1775] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:08.362306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.449305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f25bf1-1db5-4b39-b818-32b3c3d8be90 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.455293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.455911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.456196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.457761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.458505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.460449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.508922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 880/1776] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:08 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:08.513668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.528700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc99b9-de60-45f5-b780-a6cf3052207b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.612246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.613202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.613638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.613949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.614589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.616516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.641535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 897/1777] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:08 2022] POST /identity/v3/users => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:08.643051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.654802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386c21e-2785-40f5-b3f1-814010557e35 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.659992 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.660598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.661030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.661306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.661995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.663996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.675691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 881/1778] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:08.680210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.690299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063fa6f-8b8a-4fd9-ba89-cde3fb116328 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.696122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.696788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.697071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.697471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] PATH_INFO: `/v3/projects/b205cf255e724f4392ea2616b6f7ba6e/users/400408aef6a14e91a7dc7b73f20a2d30/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.723487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b205cf255e724f4392ea2616b6f7ba6e, user_id=400408aef6a14e91a7dc7b73f20a2d30, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.728462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.747790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 898/1779] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:08 2022] PUT /identity/v3/projects/b205cf255e724f4392ea2616b6f7ba6e/users/400408aef6a14e91a7dc7b73f20a2d30/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:08.753421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.786430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce76f0-0d30-4d6e-8b7c-b1b89c6d82db admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:08.909599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:08.917332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.919146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:08.954949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:08.956122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:08.956418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:08.956700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:08.957943 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:08.960570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:08.973759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 882/1780] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:08 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:08.978974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:08.991953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e100dc-a75c-4d84-a614-b932abf4e91f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:09.005775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c042839-21d9-4ba4-93b5-e2c2b6592078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:09.007800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042839-21d9-4ba4-93b5-e2c2b6592078 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:09.008086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042839-21d9-4ba4-93b5-e2c2b6592078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:09.008720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c042839-21d9-4ba4-93b5-e2c2b6592078 admin admin] PATH_INFO: `/v3/projects/b205cf255e724f4392ea2616b6f7ba6e/users/400408aef6a14e91a7dc7b73f20a2d30/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:09.014948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c042839-21d9-4ba4-93b5-e2c2b6592078 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b205cf255e724f4392ea2616b6f7ba6e, user_id=400408aef6a14e91a7dc7b73f20a2d30, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:09.017745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c042839-21d9-4ba4-93b5-e2c2b6592078 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:09.030963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f3c7d-eaf1-4837-9e27-e4640560c7ae admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:09.044894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 883/1781] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:08 2022] PUT /identity/v3/projects/b205cf255e724f4392ea2616b6f7ba6e/users/400408aef6a14e91a7dc7b73f20a2d30/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:09.045174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:09.046924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:09.047353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:09.047712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:09.086984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] MFA Rules not processed for user `400408aef6a14e91a7dc7b73f20a2d30`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:09.088782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:09.173655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:09.174699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:09.175184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:09.176284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] PATH_INFO: `/v3/projects/67eecbac7cb94fd0a097dede98f729b5` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:09.182413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67eecbac7cb94fd0a097dede98f729b5)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:09.185442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:09.221668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 884/1782] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:09.235256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:09.236639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:09.272907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67eecbac7cb94fd0a097dede98f729b5', 'request_id': 'req-ebd412b1-558c-438d-bb4e-5b1a24764a79'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.282512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67eecbac7cb94fd0a097dede98f729b5', 'request_id': 'req-ebd412b1-558c-438d-bb4e-5b1a24764a79'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.292968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67eecbac7cb94fd0a097dede98f729b5', 'request_id': 'req-ebd412b1-558c-438d-bb4e-5b1a24764a79'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.319166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] The token cache is being invalidate because project 67eecbac7cb94fd0a097dede98f729b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:09.319166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.319166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.323949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 899/1783] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:08 2022] DELETE /identity/v3/projects/67eecbac7cb94fd0a097dede98f729b5 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:09.328003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:09.330838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:09.361780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf99767-52e1-4eee-8476-bcace5eb2ef7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:09.450844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd412b1-558c-438d-bb4e-5b1a24764a79 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:09.461336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:09.462025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:09.462311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:09.462604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] PATH_INFO: `/v3/users/96a65ebfb02642e6981ec378a09ed00a` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:09.463933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a65ebfb02642e6981ec378a09ed00a)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:09.466313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:09.476348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:09.477213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:09.477566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:09.477997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:09.483454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:09.535923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a65ebfb02642e6981ec378a09ed00a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.538969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:09.549079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a65ebfb02642e6981ec378a09ed00a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.550001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a65ebfb02642e6981ec378a09ed00a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.551431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:09.572966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a65ebfb02642e6981ec378a09ed00a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.584069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a65ebfb02642e6981ec378a09ed00a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:09.594567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 900/1784] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:09 2022] DELETE /identity/v3/users/96a65ebfb02642e6981ec378a09ed00a => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:09.631460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:09.633300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:09.645766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 885/1785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:10.199301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:10.201396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:10.291890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa1bda5-3fac-4ea7-8391-96264afe0d8e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:10.297101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:10.297798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.298084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.298368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] PATH_INFO: `/v3/users/2eece2ff476049f5bead23d67f3e861d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.314641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eece2ff476049f5bead23d67f3e861d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:10.317350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:10.431183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eece2ff476049f5bead23d67f3e861d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.458667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eece2ff476049f5bead23d67f3e861d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.463154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eece2ff476049f5bead23d67f3e861d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.477089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:10.488845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af38947-2e93-40da-9106-3e30df8ffcfc service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:10.496718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:10.497381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.497662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.498661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] PATH_INFO: `/v3/projects/1fc174f947b94fe3ae21976ea7461855` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.500543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fc174f947b94fe3ae21976ea7461855)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:10.503072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:10.506034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eece2ff476049f5bead23d67f3e861d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.522068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d70e331b-e868-42d0-b100-f01f33bc8a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eece2ff476049f5bead23d67f3e861d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.535316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 901/1786] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:10 2022] DELETE /identity/v3/users/2eece2ff476049f5bead23d67f3e861d => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:10.540338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75004-88ea-46d8-9b3d-2843dc924f58 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.540531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75004-88ea-46d8-9b3d-2843dc924f58 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.540874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f75004-88ea-46d8-9b3d-2843dc924f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.566851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e8f75004-88ea-46d8-9b3d-2843dc924f58 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:10.568200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e8f75004-88ea-46d8-9b3d-2843dc924f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:10.612635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fc174f947b94fe3ae21976ea7461855', 'request_id': 'req-09ae2e79-2fae-4df4-9495-c53fb310e8a5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.630008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fc174f947b94fe3ae21976ea7461855', 'request_id': 'req-09ae2e79-2fae-4df4-9495-c53fb310e8a5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.631989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:10.641441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fc174f947b94fe3ae21976ea7461855', 'request_id': 'req-09ae2e79-2fae-4df4-9495-c53fb310e8a5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.662379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 902/1787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:10.673125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] The token cache is being invalidate because project 1fc174f947b94fe3ae21976ea7461855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:10.674309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.675472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:10.678445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 886/1788] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:10 2022] DELETE /identity/v3/projects/1fc174f947b94fe3ae21976ea7461855 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:10.684014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca20ed-2740-4903-960f-16ead7bad28c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.684744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca20ed-2740-4903-960f-16ead7bad28c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.685108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca20ed-2740-4903-960f-16ead7bad28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.718540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-69ca20ed-2740-4903-960f-16ead7bad28c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:10.720517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-69ca20ed-2740-4903-960f-16ead7bad28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:10.740402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:10.742392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:10.853119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 903/1789] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:10.859740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.860034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.860311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.866818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae2e79-2fae-4df4-9495-c53fb310e8a5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:10.878031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:10.878681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.879969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.879969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.882313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:10.896574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:10.896919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:10.899280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:10.900748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:10.923225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 904/1790] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:10.928651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 887/1791] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:10.930807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:10.941053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60943f5-c3fd-439c-8c69-9eba6b92ea53 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:10.948089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:10.948713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.948995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.949265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.950477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:10.950795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:10.952501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:10.970625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 905/1792] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:10.971955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:10.983019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9db39-fbdf-4fa0-a5c9-bf55e688fbd5 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:10.991944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:10.992572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:10.992857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:10.993134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:10.994112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:10.996982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.036403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 888/1793] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:10 2022] POST /identity/v3/projects => generated 387 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:11.040569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.055796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958019bd-5b30-480c-a930-56161340f203 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.143886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.144917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.145545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.146291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.147418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.149676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.187874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 906/1794] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:11 2022] POST /identity/v3/users => generated 294 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:11.193271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.209281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ceaef-78d1-423b-bced-c74a81d16831 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.217384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.218866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.219373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.219912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.220844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.224376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.242939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 889/1795] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:11.246823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.265012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977de1b7-e0a3-49ac-a3f5-646755d21ad8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.274106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae708fff-f657-4de8-ace7-f43905a7a2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.275283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708fff-f657-4de8-ace7-f43905a7a2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.275964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708fff-f657-4de8-ace7-f43905a7a2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.276936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae708fff-f657-4de8-ace7-f43905a7a2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.278632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708fff-f657-4de8-ace7-f43905a7a2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.280646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae708fff-f657-4de8-ace7-f43905a7a2e0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.298954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 907/1796] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:11.304176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.319803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6c31-99fa-4faf-a605-62886a620f79 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.329538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.330381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.330831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.331116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] PATH_INFO: `/v3/projects/c2f0270e4aea4f74ac503ca4aa710c60/users/88e7fe05468b4fc19dcafde38a831fe6/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.374361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f0270e4aea4f74ac503ca4aa710c60, user_id=88e7fe05468b4fc19dcafde38a831fe6, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.381952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.387178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:11.408860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 890/1797] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:11 2022] PUT /identity/v3/projects/c2f0270e4aea4f74ac503ca4aa710c60/users/88e7fe05468b4fc19dcafde38a831fe6/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:11.420379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.420718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.420940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.472989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] MFA Rules not processed for user `88e7fe05468b4fc19dcafde38a831fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:11.475999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:11.536510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:11.576559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 908/1798] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:11.583932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.701498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339d629d-0b2c-4603-9c87-ee3e3188963d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.717818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.717818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.717818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.717818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.718517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.718517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.760224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 891/1799] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:11 2022] POST /identity/v3/projects => generated 389 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:11.765419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.784305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4310c-c6f8-4581-b3e1-f0f64cffa064 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.872419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.873079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.873524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.873851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.874546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.876484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.907843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 909/1800] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:11 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:11.915610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.931352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1058c1-a70e-44dd-a62b-e746b45e1f3a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:11.938104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:11.938987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:11.939116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:11.939361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:11.940430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:11.942059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:11.979687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:11.995542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 892/1801] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:11.995739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed349d6-3839-4e36-a85a-1cf59c100b39 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:12.000862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:12.001792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:12.002109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:12.002767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] PATH_INFO: `/v3/projects/bc49d82161924a5599d504f3d5fd0c5b/users/c61e34b1cdf84161b7d07ac5292b7ce1/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:12.026130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc49d82161924a5599d504f3d5fd0c5b, user_id=c61e34b1cdf84161b7d07ac5292b7ce1, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:12.029658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:12.047581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 910/1802] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:11 2022] PUT /identity/v3/projects/bc49d82161924a5599d504f3d5fd0c5b/users/c61e34b1cdf84161b7d07ac5292b7ce1/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:12.055860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:12.069984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8009432-9f29-4d9c-a7e3-df999af6e530 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:12.180762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909a673-5032-4e1c-981d-02f414605328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:12.185784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909a673-5032-4e1c-981d-02f414605328 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:12.186121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909a673-5032-4e1c-981d-02f414605328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:12.188124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909a673-5032-4e1c-981d-02f414605328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:12.188844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909a673-5032-4e1c-981d-02f414605328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:12.194950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909a673-5032-4e1c-981d-02f414605328 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:12.219026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:12.229785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 893/1803] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:12.232184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044d433-2e3b-49e5-b04a-46be608b2c92 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:12.238539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:12.239218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:12.239504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:12.239926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] PATH_INFO: `/v3/projects/bc49d82161924a5599d504f3d5fd0c5b/users/c61e34b1cdf84161b7d07ac5292b7ce1/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:12.242579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc49d82161924a5599d504f3d5fd0c5b, user_id=c61e34b1cdf84161b7d07ac5292b7ce1, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:12.246939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:12.260379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 911/1804] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:12 2022] PUT /identity/v3/projects/bc49d82161924a5599d504f3d5fd0c5b/users/c61e34b1cdf84161b7d07ac5292b7ce1/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:12.273047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:12.273339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:12.273617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:12.343377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] MFA Rules not processed for user `c61e34b1cdf84161b7d07ac5292b7ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:12.346911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:12.460204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:12.484845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 894/1805] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:12.501914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:12.503403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:12.505648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:12.506867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:12.619617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670a13d-fd19-444b-bb49-291e7c8252c5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:12.626575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:12.627490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:12.627903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:12.628450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] PATH_INFO: `/v3/projects/08e2747f84704b808be50fd512e1a33c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:12.630784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e2747f84704b808be50fd512e1a33c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:12.634768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:12.635348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e0567-4a82-4d37-925d-12eac7e56a1a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:12.643982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:12.645225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:12.645558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:12.645869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:12.667507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:12.669049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:12.693010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:12.695157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 895/1806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:12 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:12.726728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e2747f84704b808be50fd512e1a33c', 'request_id': 'req-0ae260ae-f4c2-4d77-b463-09fa00f961ca'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:12.752069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e2747f84704b808be50fd512e1a33c', 'request_id': 'req-0ae260ae-f4c2-4d77-b463-09fa00f961ca'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:12.777718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e2747f84704b808be50fd512e1a33c', 'request_id': 'req-0ae260ae-f4c2-4d77-b463-09fa00f961ca'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:12.799088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] The token cache is being invalidate because project 08e2747f84704b808be50fd512e1a33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:12.799668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:12.800661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:12.805913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 912/1807] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:12 2022] DELETE /identity/v3/projects/08e2747f84704b808be50fd512e1a33c => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:12.807174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:12.819806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032bf44-e278-4b64-bfdb-4cabd44670cf service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:12.984210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:12.986066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:13.044770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:13.045413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.045692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.045997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] PATH_INFO: `/v3/users/400408aef6a14e91a7dc7b73f20a2d30` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.047591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=400408aef6a14e91a7dc7b73f20a2d30)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:13.049857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:13.150231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae260ae-f4c2-4d77-b463-09fa00f961ca admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:13.154826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:13.155831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.156123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.156409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] PATH_INFO: `/v3/users/88e7fe05468b4fc19dcafde38a831fe6` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.161273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e7fe05468b4fc19dcafde38a831fe6)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:13.165166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400408aef6a14e91a7dc7b73f20a2d30'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.173879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:13.178189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400408aef6a14e91a7dc7b73f20a2d30'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.179703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400408aef6a14e91a7dc7b73f20a2d30'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.211113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400408aef6a14e91a7dc7b73f20a2d30'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.212276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a19007d0-a29e-4826-9c44-86a00bd9a4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400408aef6a14e91a7dc7b73f20a2d30'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.255240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 896/1808] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:12 2022] DELETE /identity/v3/users/400408aef6a14e91a7dc7b73f20a2d30 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:13.256079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1921-c11d-4b85-bf36-31d2f411265a None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.256434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1921-c11d-4b85-bf36-31d2f411265a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.256632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb1921-c11d-4b85-bf36-31d2f411265a None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.258764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 897/1809] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:16:13.272786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.273074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.273356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.276496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e7fe05468b4fc19dcafde38a831fe6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.288403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e7fe05468b4fc19dcafde38a831fe6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.289649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e7fe05468b4fc19dcafde38a831fe6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.303517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:13.304885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:13.310231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e7fe05468b4fc19dcafde38a831fe6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.310688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:13.325741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-876e13ac-397a-422a-afdb-dcb66e3bd35e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e7fe05468b4fc19dcafde38a831fe6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.335442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 913/1810] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:12 2022] DELETE /identity/v3/users/88e7fe05468b4fc19dcafde38a831fe6 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:13.340795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.341206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.342102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.369398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:13.371117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:13.404314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 898/1811] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:16:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:13.428819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:13.481279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 914/1812] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:13.507804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:13.509273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:13.559316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:13.562625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:13.656631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958692b8-e112-48f6-8e1b-2299bdec03c1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:13.722095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95ee69-b37e-4a53-b7ba-10720692fa3a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:13.732126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:13.732752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.733037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.733322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.737199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a814f3a-1cf3-44a3-913b-27df16087f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:13.738849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814f3a-1cf3-44a3-913b-27df16087f1a service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.739367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814f3a-1cf3-44a3-913b-27df16087f1a service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.739877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a814f3a-1cf3-44a3-913b-27df16087f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.744049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:13.746164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:13.754927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a814f3a-1cf3-44a3-913b-27df16087f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:13.760955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a814f3a-1cf3-44a3-913b-27df16087f1a service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:13.768007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 899/1813] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:13.801851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 915/1814] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:13.855771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:13.858081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:13.874763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e9224-4903-4a53-82c2-831cdcd427bf service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:13.881985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:13.882609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:13.883257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:13.883366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] PATH_INFO: `/v3/projects/b205cf255e724f4392ea2616b6f7ba6e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:13.895270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b205cf255e724f4392ea2616b6f7ba6e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:13.899115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:13.985519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b205cf255e724f4392ea2616b6f7ba6e', 'request_id': 'req-e6ac4fed-6361-4c99-965e-658f36d421b1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.996267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b205cf255e724f4392ea2616b6f7ba6e', 'request_id': 'req-e6ac4fed-6361-4c99-965e-658f36d421b1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:13.998353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:14.006845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b205cf255e724f4392ea2616b6f7ba6e', 'request_id': 'req-e6ac4fed-6361-4c99-965e-658f36d421b1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.025878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] The token cache is being invalidate because project b205cf255e724f4392ea2616b6f7ba6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:14.026364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.027397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-e6ac4fed-6361-4c99-965e-658f36d421b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.029919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 900/1815] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:13 2022] DELETE /identity/v3/projects/b205cf255e724f4392ea2616b6f7ba6e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:14.034611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.034935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.035729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.079086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:14.081544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:14.161736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 916/1816] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:14.169441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.169886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.170167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.209876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:14.212378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:14.229420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 901/1817] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:14.229677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.246953 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46e00f-a3ee-42e7-aba7-001acf936e5a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.254581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.256077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.256552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.257169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.259353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:14.259958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.264629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.299620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.301922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 917/1818] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:14.310981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfa143-1858-48af-9cf1-d838b69b53b7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.317499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.318691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.318977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.319254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.320149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.322009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.361906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 902/1819] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:14 2022] POST /identity/v3/projects => generated 363 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:14.364758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.384592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d395a920-ad61-4fbb-af02-9a75aac4d08a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.527931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:14.572829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.574441 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.574752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.575037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.575787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.578952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.606148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.607938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:14.630114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345b65-608f-44a6-97cf-0a62ade48e2d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.633403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 918/1820] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:14 2022] POST /identity/v3/users => generated 282 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:14.638214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.641067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.641744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.642025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.642299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] PATH_INFO: `/v3/projects/c2f0270e4aea4f74ac503ca4aa710c60` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.643607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f0270e4aea4f74ac503ca4aa710c60)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.645757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.666651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95909499-c64b-4a90-8c17-8ed54fd62878 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.685977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.687704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.688889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.689335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.692252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.694454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.707526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 919/1821] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:14.711773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.723230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59397-ce17-43eb-b18b-e6402264bee7 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.729218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.730345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.730528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.730848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.731554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.733498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.754918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 920/1822] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:14.755723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.773288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6573f3-c7d6-4c2d-8bd9-ce4a301110fc admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.782712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f0270e4aea4f74ac503ca4aa710c60', 'request_id': 'req-423709a1-50af-4d4c-9c45-cb9e246113e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.798543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f0270e4aea4f74ac503ca4aa710c60', 'request_id': 'req-423709a1-50af-4d4c-9c45-cb9e246113e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.810812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f0270e4aea4f74ac503ca4aa710c60', 'request_id': 'req-423709a1-50af-4d4c-9c45-cb9e246113e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.827892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] The token cache is being invalidate because project c2f0270e4aea4f74ac503ca4aa710c60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:14.828101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.829201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:14.834179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 903/1823] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:14 2022] DELETE /identity/v3/projects/c2f0270e4aea4f74ac503ca4aa710c60 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:14.838680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:14.840775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:14.858720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a02be6-f638-42ce-b709-9064125c28d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:14.859666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a02be6-f638-42ce-b709-9064125c28d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.860178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a02be6-f638-42ce-b709-9064125c28d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.860702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a02be6-f638-42ce-b709-9064125c28d6 admin admin] PATH_INFO: `/v3/projects/8fcab31249b0428690425d958839f74d/users/c9eb843ce6c24e418fd94489c3337584/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.893733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a02be6-f638-42ce-b709-9064125c28d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8fcab31249b0428690425d958839f74d, user_id=c9eb843ce6c24e418fd94489c3337584, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:14.902769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a02be6-f638-42ce-b709-9064125c28d6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:14.933451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 921/1824] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:14 2022] PUT /identity/v3/projects/8fcab31249b0428690425d958839f74d/users/c9eb843ce6c24e418fd94489c3337584/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:14.947217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:14.947595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:14.947769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:14.956295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423709a1-50af-4d4c-9c45-cb9e246113e4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:14.986098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] MFA Rules not processed for user `c9eb843ce6c24e418fd94489c3337584`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:14.987709 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:15.015108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:15.061878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.063734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.065103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.066759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] PATH_INFO: `/v3/users/c61e34b1cdf84161b7d07ac5292b7ce1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.069840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c61e34b1cdf84161b7d07ac5292b7ce1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.071837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.159561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 922/1825] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:15.161872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.163567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:15.180467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eab2ef-9e34-423a-b9cd-c13be3db9eeb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.183828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c61e34b1cdf84161b7d07ac5292b7ce1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.187882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.188689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.189165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.189592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.190517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.192686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.194078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c61e34b1cdf84161b7d07ac5292b7ce1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.194882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c61e34b1cdf84161b7d07ac5292b7ce1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.203805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c61e34b1cdf84161b7d07ac5292b7ce1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.204933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c61e34b1cdf84161b7d07ac5292b7ce1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.227070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 923/1826] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:15 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:15.230882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.232622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:15.233782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 904/1827] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:14 2022] DELETE /identity/v3/users/c61e34b1cdf84161b7d07ac5292b7ce1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:15.248419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:15.339979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2abf1f9-232c-4fc5-942b-ecd416bf15b7 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.412235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.412862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.413144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.413424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.414100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.416057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.443124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 924/1828] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:15 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:15.445124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.458630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24649301-cc6c-46ef-be1e-f3182d9ce837 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.466415 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.467386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.467729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.468494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.469227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.471011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.486538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 905/1829] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:15.488071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.504561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb955e0-d6da-4150-a14f-0ee3183e0b8d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.510374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.511164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.511510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.511990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] PATH_INFO: `/v3/projects/75139b74adf345b097f435b7b65f65e3/users/87e67343332a4dcf89e99f89caf4e915/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.530520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75139b74adf345b097f435b7b65f65e3, user_id=87e67343332a4dcf89e99f89caf4e915, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.533635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.570494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 925/1830] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:15 2022] PUT /identity/v3/projects/75139b74adf345b097f435b7b65f65e3/users/87e67343332a4dcf89e99f89caf4e915/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:15.574641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.592738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e9383-d609-42bc-a2c9-802a562066c4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.697614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.699929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:15.731906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.732534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.732816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.733088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.734208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.735546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.749838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 906/1831] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:15.752041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.765273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c623064b-1115-4908-b3f4-50d10bdaad39 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.770176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de9868-32b7-4e77-8f1b-df6a002d2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.770946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de9868-32b7-4e77-8f1b-df6a002d2b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.771489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de9868-32b7-4e77-8f1b-df6a002d2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.771816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de9868-32b7-4e77-8f1b-df6a002d2b7a admin admin] PATH_INFO: `/v3/projects/75139b74adf345b097f435b7b65f65e3/users/87e67343332a4dcf89e99f89caf4e915/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.773941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de9868-32b7-4e77-8f1b-df6a002d2b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75139b74adf345b097f435b7b65f65e3, user_id=87e67343332a4dcf89e99f89caf4e915, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.777358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de9868-32b7-4e77-8f1b-df6a002d2b7a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.793871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 907/1832] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:15 2022] PUT /identity/v3/projects/75139b74adf345b097f435b7b65f65e3/users/87e67343332a4dcf89e99f89caf4e915/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:15.806436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.806761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.807109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.825592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d54181-2642-4d81-8b6e-7e14966b58b5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:15.838043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] MFA Rules not processed for user `87e67343332a4dcf89e99f89caf4e915`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:15.839309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:15.852010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:15.868078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:15.888084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:15.888761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.889046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.889314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] PATH_INFO: `/v3/projects/bc49d82161924a5599d504f3d5fd0c5b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:15.890759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc49d82161924a5599d504f3d5fd0c5b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:15.892654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:15.919005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 908/1833] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:15 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:15.931299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:15.932722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:15.950814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc49d82161924a5599d504f3d5fd0c5b', 'request_id': 'req-e8313bee-5780-4947-b24a-32ed444761df'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.960379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc49d82161924a5599d504f3d5fd0c5b', 'request_id': 'req-e8313bee-5780-4947-b24a-32ed444761df'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.967704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc49d82161924a5599d504f3d5fd0c5b', 'request_id': 'req-e8313bee-5780-4947-b24a-32ed444761df'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.978976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] The token cache is being invalidate because project bc49d82161924a5599d504f3d5fd0c5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:15.979267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.979939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e8313bee-5780-4947-b24a-32ed444761df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:15.981470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 926/1834] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:15 2022] DELETE /identity/v3/projects/bc49d82161924a5599d504f3d5fd0c5b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:15.986259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b88781-b142-4748-9aea-b082424a0ed1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:15.986540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b88781-b142-4748-9aea-b082424a0ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:15.986815 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b88781-b142-4748-9aea-b082424a0ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.003615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0503b69-674b-41f5-bd5f-9f729b1ce2ad None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.010018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-14b88781-b142-4748-9aea-b082424a0ed1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:16.011232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-14b88781-b142-4748-9aea-b082424a0ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.069574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.070846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.070846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.071152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.073005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.111454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 927/1835] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:16.121660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.122057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.122338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.143181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:16.144431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.153284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 928/1836] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:16.157174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.158147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.159598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.167335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984abd4-acf2-424a-93a6-26a88ffab249 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.172646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.173373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.173663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.173967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.174740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:16.175048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.177848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.177988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 909/1837] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:16.194299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 929/1838] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:16.195250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.207714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0118a-6f46-470d-8681-939d8383d134 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.212860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.218806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.218806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.218806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.218806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.218806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.259976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 910/1839] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:16 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:16.263838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.276568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedd9060-fe1a-416f-9fbe-6c1427773e32 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.290326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.292528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.307547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:16.335672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:16.360977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.361580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.361910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.362187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.363732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.365802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.369269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb4c9f-bc8b-4c11-be3e-0b3d01210df3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.373055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.373660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.374039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.374314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.376446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.390537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 930/1840] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:16 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:16.395302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.407446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd91e7-7446-4b7d-ba5b-19a7edd6d9ce admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.416890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.417575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.417913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.418192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.419870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.420530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.435889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 931/1841] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:16.440038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.450608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388e85a-f539-4dd5-959c-1d6cc8cdb32b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.455581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.456177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.456500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.456748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.458343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.459710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.459990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.462148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11e7838-4548-44fa-acb5-77cc1dfdccc3 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.471727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 932/1842] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:16.474444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 911/1843] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:16.476068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.486306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c3ad6-390d-495c-94ef-65af46405f5d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.491459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.492118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.492400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.492667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] PATH_INFO: `/v3/projects/dc9401cac5074ee89a44017e88bf04d5/users/26a8132cb5d240a99bf726148037acf8/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.513457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc9401cac5074ee89a44017e88bf04d5, user_id=26a8132cb5d240a99bf726148037acf8, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.516167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.532320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 933/1844] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:16 2022] PUT /identity/v3/projects/dc9401cac5074ee89a44017e88bf04d5/users/26a8132cb5d240a99bf726148037acf8/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:16.538146 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.539227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.539227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.577119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:16.579976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.691747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 912/1845] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:16.698507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:16.701977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:16.793440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96741088-9d0b-4738-a6d9-32162488a454 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:16.817340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f50199-bd1b-472e-b11b-35149d3661b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:16.818013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50199-bd1b-472e-b11b-35149d3661b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:16.818298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50199-bd1b-472e-b11b-35149d3661b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:16.818894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f50199-bd1b-472e-b11b-35149d3661b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:16.846978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f50199-bd1b-472e-b11b-35149d3661b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:16.848848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f50199-bd1b-472e-b11b-35149d3661b8 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:16.863813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 934/1846] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:17.392462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:17.396005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:17.435197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ef53c-f9db-4d20-b285-4251013890aa None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:17.449096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:17.449971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:17.450303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:17.450668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] PATH_INFO: `/v3/users/91082cf748e84f638e4dcec340dfbc6f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:17.452181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91082cf748e84f638e4dcec340dfbc6f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:17.455860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:17.524721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91082cf748e84f638e4dcec340dfbc6f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:17.539033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91082cf748e84f638e4dcec340dfbc6f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:17.543435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91082cf748e84f638e4dcec340dfbc6f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:17.545507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:17.555062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91082cf748e84f638e4dcec340dfbc6f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:17.555767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91082cf748e84f638e4dcec340dfbc6f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:17.602481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 913/1847] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:17 2022] DELETE /identity/v3/users/91082cf748e84f638e4dcec340dfbc6f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:17.603239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80d17f-bd8a-47fc-b6f6-6f019dc2a010 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:17.603640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80d17f-bd8a-47fc-b6f6-6f019dc2a010 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:17.603803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80d17f-bd8a-47fc-b6f6-6f019dc2a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:17.627776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6d80d17f-bd8a-47fc-b6f6-6f019dc2a010 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:17.629808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6d80d17f-bd8a-47fc-b6f6-6f019dc2a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:17.700280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 935/1848] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:17.711585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:17.713102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:17.795253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d1b99e-f40b-4ee2-820a-85efd1ba3687 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:17.799158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:17.799707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:17.799994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:17.800271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:17.812567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:17.814065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:17.834823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 914/1849] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:18.419790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:18.420091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:18.420396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:18.453480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] MFA Rules not processed for user `26a8132cb5d240a99bf726148037acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:18.454758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:18.469280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:18.546375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 936/1850] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:18.555091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:18.558061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:18.580789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d121c8-3546-474f-b887-4ec6e2c79a86 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:18.588654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:18.589217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:18.589567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:18.599474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:18.601021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:18.604459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:18.663460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 915/1851] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:18 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:18.664876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:18.680746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4053d4fd-0dbe-4a36-8ea1-f8c37ab46028 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:18.771956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:18.772714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:18.773376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:18.773945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:18.774675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:18.777175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:18.815389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 937/1852] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:18 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:18.820120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:18.833824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943077ca-14e8-410a-8159-3648bcacd936 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:18.834739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:18.836477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:18.840824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:18.841492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:18.841815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:18.842096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:18.842751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:18.844544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:18.854796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ba494-93d0-4f57-ac24-1ef57365968e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:18.887800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:18.891664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:18.891982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:18.892731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] PATH_INFO: `/v3/projects/3a9a878a22b64f9887c03ff8b597a0cf` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:18.893374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 916/1853] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:18.895042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9a878a22b64f9887c03ff8b597a0cf)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:18.898196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:18.903926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:18.937039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ad211-b947-47bb-a51f-964fa0dac3ce admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:18.950340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:18.951090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:18.952117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:18.952117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] PATH_INFO: `/v3/projects/a4b32590ce4c421e9e28783ecf8b32e7/users/faa539ee67d84a7888698b16a77cd956/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:18.986674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b32590ce4c421e9e28783ecf8b32e7, user_id=faa539ee67d84a7888698b16a77cd956, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:18.990134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:19.025961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 917/1854] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:18 2022] PUT /identity/v3/projects/a4b32590ce4c421e9e28783ecf8b32e7/users/faa539ee67d84a7888698b16a77cd956/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:19.030011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:19.032543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9a878a22b64f9887c03ff8b597a0cf', 'request_id': 'req-226be543-5886-49a9-aaf6-b4524146d509'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.049257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9a878a22b64f9887c03ff8b597a0cf', 'request_id': 'req-226be543-5886-49a9-aaf6-b4524146d509'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.064711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9a878a22b64f9887c03ff8b597a0cf', 'request_id': 'req-226be543-5886-49a9-aaf6-b4524146d509'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.092802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] The token cache is being invalidate because project 3a9a878a22b64f9887c03ff8b597a0cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:19.094207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.095398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.098963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 938/1855] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:18 2022] DELETE /identity/v3/projects/3a9a878a22b64f9887c03ff8b597a0cf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:19.102666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:19.105940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:19.136301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56f9f1e-e35a-40a2-b99c-0dc047c647b5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:19.151345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:19.165325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:19.193925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226be543-5886-49a9-aaf6-b4524146d509 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:19.199205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:19.199925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:19.200285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:19.200632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] PATH_INFO: `/v3/users/b0bca09ba91c4f0e87894f40954b51e1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:19.201899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0bca09ba91c4f0e87894f40954b51e1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:19.203907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:19.208183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:19.208789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:19.209064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:19.209333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:19.210008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:19.211672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:19.224218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 918/1856] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:19.229524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:19.232477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:19.255567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1d59ac-5d94-41cf-b53a-c1e90ed695c2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:19.262025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:19.263790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:19.264121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:19.264400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] PATH_INFO: `/v3/projects/a4b32590ce4c421e9e28783ecf8b32e7/users/faa539ee67d84a7888698b16a77cd956/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:19.267084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b32590ce4c421e9e28783ecf8b32e7, user_id=faa539ee67d84a7888698b16a77cd956, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:19.271101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:19.288835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 919/1857] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:19 2022] PUT /identity/v3/projects/a4b32590ce4c421e9e28783ecf8b32e7/users/faa539ee67d84a7888698b16a77cd956/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:19.291312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0bca09ba91c4f0e87894f40954b51e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.299296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0bca09ba91c4f0e87894f40954b51e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.300439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0bca09ba91c4f0e87894f40954b51e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.336088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0bca09ba91c4f0e87894f40954b51e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.350304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b3b8c699-dc92-4fb4-9094-414d4053a8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0bca09ba91c4f0e87894f40954b51e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:19.360552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 939/1858] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:19 2022] DELETE /identity/v3/users/b0bca09ba91c4f0e87894f40954b51e1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:20.321791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:20.326264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:20.467591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c8cca-b41e-4be2-8108-f4258e063984 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:20.593299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:20.594274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.594652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.594884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] PATH_INFO: `/v3/projects/18097ab85a8a42f7ba9fb3de5883d4d0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.596440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18097ab85a8a42f7ba9fb3de5883d4d0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:20.599203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:20.670705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18097ab85a8a42f7ba9fb3de5883d4d0', 'request_id': 'req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:20.682173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18097ab85a8a42f7ba9fb3de5883d4d0', 'request_id': 'req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:20.685960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:20.694233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18097ab85a8a42f7ba9fb3de5883d4d0', 'request_id': 'req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:20.709592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] The token cache is being invalidate because project 18097ab85a8a42f7ba9fb3de5883d4d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:20.709923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:20.710594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3dcecccc-54ef-4fe6-af5e-bff4c3aac809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:20.712330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 920/1859] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:20 2022] DELETE /identity/v3/projects/18097ab85a8a42f7ba9fb3de5883d4d0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:20.716944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455413f-674b-4ca7-8781-60d58a3f295b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.717416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455413f-674b-4ca7-8781-60d58a3f295b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.717522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455413f-674b-4ca7-8781-60d58a3f295b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.739707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9455413f-674b-4ca7-8781-60d58a3f295b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:20.741087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9455413f-674b-4ca7-8781-60d58a3f295b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:20.772929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962225e-94a1-427b-8d24-bb1e4fca88b3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.773212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962225e-94a1-427b-8d24-bb1e4fca88b3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.773486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962225e-94a1-427b-8d24-bb1e4fca88b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.811196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f962225e-94a1-427b-8d24-bb1e4fca88b3 None None] MFA Rules not processed for user `faa539ee67d84a7888698b16a77cd956`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:20.812804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f962225e-94a1-427b-8d24-bb1e4fca88b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:20.821927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 940/1860] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:20.827036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.827325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.827598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.853656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:20.854926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:20.868819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 941/1861] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:20.869994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:20.882666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46463674-9b9b-44b6-beea-4f3a05fe2eaa None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:20.888540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:20.889166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.889444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.889739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.890847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:20.891157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:20.892763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:20.913819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 942/1862] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:20.913819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:20.924209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21557e32-2cdb-424a-bcef-3ba6a45b0ad0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:20.929810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:20.930425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.930753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.931084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.931778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:20.933874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:20.963529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 921/1863] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:20.965022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26286-df9a-4663-a051-60721b53240a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:20.965405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26286-df9a-4663-a051-60721b53240a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:20.965592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f26286-df9a-4663-a051-60721b53240a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:20.989271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 943/1864] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:20 2022] POST /identity/v3/projects => generated 387 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:20.990475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-40f26286-df9a-4663-a051-60721b53240a None None] MFA Rules not processed for user `26a8132cb5d240a99bf726148037acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:20.991702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-40f26286-df9a-4663-a051-60721b53240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:20.995070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.006870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:21.074972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 922/1865] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:21.086675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c4658-dd82-4461-8fd6-4298a6ccca5f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.088417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f26286-df9a-4663-a051-60721b53240a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.089651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-40f26286-df9a-4663-a051-60721b53240a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:21.094761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.095672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.097687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.098307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.099592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.103243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.133776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 944/1866] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:20 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:21.139144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.154176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37cec4-3fec-4872-b0cd-154d3dfabddc admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.178974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.180008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.180977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.184418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.187030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.190346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f26286-df9a-4663-a051-60721b53240a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.196182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.216052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.216790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.217141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.217484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.219882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 945/1867] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:21.220814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:21.224651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.240527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ecf83a-674e-4186-afad-3376b146a812 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.246501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.247188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.247479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.247758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.248459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.250168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.260074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.261783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d28d45-afe2-47e5-809d-1c31528a2220 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.262322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 946/1868] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:21.267303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.276356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 923/1869] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:21.284345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef7340e-ad50-4d29-bb82-ad5a744c38dd admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.292517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.293485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.294029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.294424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] PATH_INFO: `/v3/projects/62cd6a64d4e842569795094134c812a6/users/f8c0e39b38364552890fe7c706ed211e/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.314616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62cd6a64d4e842569795094134c812a6, user_id=f8c0e39b38364552890fe7c706ed211e, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.318423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.343100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 947/1870] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:21 2022] PUT /identity/v3/projects/62cd6a64d4e842569795094134c812a6/users/f8c0e39b38364552890fe7c706ed211e/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:21.353770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.354202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.354202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.369455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:21.403755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] MFA Rules not processed for user `f8c0e39b38364552890fe7c706ed211e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:21.405343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:21.533526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 924/1871] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:21.538784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.609976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ffa2ed-5917-4e3b-acd6-10e119bd681f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.616487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.624901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.625336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.625622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.626407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.628358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.665261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 948/1872] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:21 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:21.669604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.683851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dcb7f2-f11b-41fd-831c-8e5c30cdcd64 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.786634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.787480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.787902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.788458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.789258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.791728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.849963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.850507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 925/1873] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:21 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:21.859821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b29e6-b8ce-4de7-9b95-71162368b319 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.866445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.867158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.867512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.867858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.868715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.870380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.885123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 949/1874] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:21.889292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:21.901270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290655c6-96c9-484c-b227-547fef612f19 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:21.923768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:21.924449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:21.924732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:21.925010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] PATH_INFO: `/v3/projects/d2197d1abdc04ae48c174eea657bfd9c/users/f5ee7e6bf75140348ffb9af49bccc7bc/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:21.967451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2197d1abdc04ae48c174eea657bfd9c, user_id=f5ee7e6bf75140348ffb9af49bccc7bc, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:21.970897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:21.990448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 926/1875] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:21 2022] PUT /identity/v3/projects/d2197d1abdc04ae48c174eea657bfd9c/users/f5ee7e6bf75140348ffb9af49bccc7bc/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:21.991365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:22.016429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9cb16-f88d-4de7-b3eb-ad21196540f5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:22.057235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:22.134239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2bf68-d9df-4cb8-94a0-94e089450def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:22.135202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2bf68-d9df-4cb8-94a0-94e089450def admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:22.136518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2bf68-d9df-4cb8-94a0-94e089450def admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:22.137219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2bf68-d9df-4cb8-94a0-94e089450def admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:22.139195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2bf68-d9df-4cb8-94a0-94e089450def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:22.140958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2bf68-d9df-4cb8-94a0-94e089450def admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:22.170160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 950/1876] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:22.170460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:22.185782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f4598-159e-4bbd-9f07-df051945f135 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:22.202519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:22.202519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:22.202519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:22.202519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] PATH_INFO: `/v3/projects/d2197d1abdc04ae48c174eea657bfd9c/users/f5ee7e6bf75140348ffb9af49bccc7bc/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:22.203064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2197d1abdc04ae48c174eea657bfd9c, user_id=f5ee7e6bf75140348ffb9af49bccc7bc, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:22.203760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:22.228816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 927/1877] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:22 2022] PUT /identity/v3/projects/d2197d1abdc04ae48c174eea657bfd9c/users/f5ee7e6bf75140348ffb9af49bccc7bc/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:22.240753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:22.241105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:22.241386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:22.272704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] MFA Rules not processed for user `f5ee7e6bf75140348ffb9af49bccc7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:22.273977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:22.390034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 951/1878] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:22 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:22.402720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:22.407156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:22.506422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:22.530483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5573bd-e811-4b43-98e5-bb141b56045a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:22.539426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9b9b6-b09e-42cb-8f8d-b6c68c5a96c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:22.540755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b9b6-b09e-42cb-8f8d-b6c68c5a96c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:22.541576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b9b6-b09e-42cb-8f8d-b6c68c5a96c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:22.542039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9b9b6-b09e-42cb-8f8d-b6c68c5a96c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:22.554193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b9b6-b09e-42cb-8f8d-b6c68c5a96c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:22.555944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9b9b6-b09e-42cb-8f8d-b6c68c5a96c8 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:22.570271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 928/1879] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:22.683533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:22.763168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c610ce-3b0c-43e6-b7f3-2ae741d5bc8c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:22.768448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:22.768609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:22.768821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:22.769097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] PATH_INFO: `/v3/users/f8c0e39b38364552890fe7c706ed211e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:22.770682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c0e39b38364552890fe7c706ed211e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:22.772899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:22.840237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c0e39b38364552890fe7c706ed211e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:22.841764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:22.851423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c0e39b38364552890fe7c706ed211e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:22.852301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c0e39b38364552890fe7c706ed211e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:22.867254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c0e39b38364552890fe7c706ed211e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:22.875512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c0e39b38364552890fe7c706ed211e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:22.883599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 952/1880] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:22 2022] DELETE /identity/v3/users/f8c0e39b38364552890fe7c706ed211e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:22.887874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:22.888167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:22.888444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:22.912067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:22.913303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:23.033241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 929/1881] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:23.107346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:23.108708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:23.280014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a1a35-8461-4229-9e40-0cccf34bf678 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:23.293590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:23.294686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:23.295178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:23.295775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:23.345836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:23.346927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:23.368846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 953/1882] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:24.125688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:24.127314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:24.148695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9a5a4-f3cf-42f4-aaf2-84e55a7dc050 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:24.182058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:24.182710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:24.182986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:24.183256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] PATH_INFO: `/v3/projects/62cd6a64d4e842569795094134c812a6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:24.184594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62cd6a64d4e842569795094134c812a6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:24.186743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:24.240983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62cd6a64d4e842569795094134c812a6', 'request_id': 'req-35c7ab58-660b-410b-98a0-54d9afdc09f9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.249664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62cd6a64d4e842569795094134c812a6', 'request_id': 'req-35c7ab58-660b-410b-98a0-54d9afdc09f9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.258305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62cd6a64d4e842569795094134c812a6', 'request_id': 'req-35c7ab58-660b-410b-98a0-54d9afdc09f9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.280108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] The token cache is being invalidate because project 62cd6a64d4e842569795094134c812a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:24.280411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.281083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.282826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 930/1883] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:24 2022] DELETE /identity/v3/projects/62cd6a64d4e842569795094134c812a6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:24.287018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:24.297363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0e017-70d1-44c2-9496-8d3e470d3657 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:24.357354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:24.358027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:24.358308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:24.358581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] PATH_INFO: `/v3/users/f5ee7e6bf75140348ffb9af49bccc7bc` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:24.359702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ee7e6bf75140348ffb9af49bccc7bc)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:24.361614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:24.424926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ee7e6bf75140348ffb9af49bccc7bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.433079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ee7e6bf75140348ffb9af49bccc7bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.433873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ee7e6bf75140348ffb9af49bccc7bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.445057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:24.447650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ee7e6bf75140348ffb9af49bccc7bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.456273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-0608db67-09d3-40d7-9e60-599aa3e51a6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ee7e6bf75140348ffb9af49bccc7bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.464203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 954/1884] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:24 2022] DELETE /identity/v3/users/f5ee7e6bf75140348ffb9af49bccc7bc => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:24.762302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:24.764229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:24.784148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c7ab58-660b-410b-98a0-54d9afdc09f9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:24.852862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:24.853491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:24.853803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:24.854082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] PATH_INFO: `/v3/projects/d2197d1abdc04ae48c174eea657bfd9c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:24.855235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2197d1abdc04ae48c174eea657bfd9c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:24.857290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:24.870269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:24.928939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2197d1abdc04ae48c174eea657bfd9c', 'request_id': 'req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.940201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2197d1abdc04ae48c174eea657bfd9c', 'request_id': 'req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.950437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2197d1abdc04ae48c174eea657bfd9c', 'request_id': 'req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.964276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] The token cache is being invalidate because project d2197d1abdc04ae48c174eea657bfd9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:24.965151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.965926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-10dddd2e-1802-4817-8c6d-0bc47bdc8e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:24.968368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 931/1885] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:24 2022] DELETE /identity/v3/projects/d2197d1abdc04ae48c174eea657bfd9c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:24.973231 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:24.973633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:24.974300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.004829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:25.007188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.128471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 955/1886] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:25.137366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.137853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.138228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.172202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:25.173436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.183404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 932/1887] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:25.187866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.202658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0eff09-ba70-4967-aafe-c4b6150ac77a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.209851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.210646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.212290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.212492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.213915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:25.214226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.216056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.233968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 956/1888] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:25.235100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.246181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1777e-68a3-489a-86e4-16d3d5484320 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.251459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.252096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.252380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.252657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.253296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.256036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.340993 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.341541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 933/1889] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:25.347921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.351328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.355718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d19e4-b689-4705-8c71-2eb6ba09ffbf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.439513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.440337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.440792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.441257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.442351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.444842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.454656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95a39-689e-4820-9341-1217ccba5392 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.460743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.461473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.461790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.462177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] PATH_INFO: `/v3/users/c9eb843ce6c24e418fd94489c3337584` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.464462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9eb843ce6c24e418fd94489c3337584)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.466914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.497208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 957/1890] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:25 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:25.501384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.519062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307c9d25-37d5-490d-b5f2-6862379d8a52 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.528519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.529614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.530220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.530650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.531466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.534554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.543258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9eb843ce6c24e418fd94489c3337584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:25.550754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9eb843ce6c24e418fd94489c3337584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:25.551948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9eb843ce6c24e418fd94489c3337584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:25.560311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 958/1891] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:25.563885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.566839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9eb843ce6c24e418fd94489c3337584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:25.567690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ee9c2e7f-29ed-48d0-928c-9cd6864b8f8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9eb843ce6c24e418fd94489c3337584'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:25.577736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:25.585117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a65ef7-e92e-4320-8632-255664ce3485 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.591894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 934/1892] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:25 2022] DELETE /identity/v3/users/c9eb843ce6c24e418fd94489c3337584 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:25.594210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.595787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.596459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.599073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.599073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.599073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.601179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.604494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.608238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.625572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:25.626948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.633747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 959/1893] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:25.638129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.641107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.672766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ab24-439c-4124-8e89-6aad94c9c469 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.743017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:25.779269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 935/1894] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:25.782610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4391958-7cee-4f29-90ae-75a303e3c2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.784267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391958-7cee-4f29-90ae-75a303e3c2ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.784267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391958-7cee-4f29-90ae-75a303e3c2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.793350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:25.793902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4391958-7cee-4f29-90ae-75a303e3c2ba admin admin] PATH_INFO: `/v3/projects/edde214edf5e499fa2e14441681d7078/users/b4280df11eee4c39bd01dbc8a7f39871/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.795127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.812538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4391958-7cee-4f29-90ae-75a303e3c2ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=edde214edf5e499fa2e14441681d7078, user_id=b4280df11eee4c39bd01dbc8a7f39871, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:25.815456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4391958-7cee-4f29-90ae-75a303e3c2ba admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:25.830683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 960/1895] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:25 2022] PUT /identity/v3/projects/edde214edf5e499fa2e14441681d7078/users/b4280df11eee4c39bd01dbc8a7f39871/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:25.842002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3463-8567-4280-adb0-eb702e9756de None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.842290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3463-8567-4280-adb0-eb702e9756de None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.842590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db3463-8567-4280-adb0-eb702e9756de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.865626 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09420d0c-dc90-48fb-babc-71098661f1c5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:25.873061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-37db3463-8567-4280-adb0-eb702e9756de None None] MFA Rules not processed for user `b4280df11eee4c39bd01dbc8a7f39871`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:25.874299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-37db3463-8567-4280-adb0-eb702e9756de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:25.932350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:25.933530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:25.934005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:25.934735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:25.946801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 961/1896] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:25.951259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3463-8567-4280-adb0-eb702e9756de None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.006012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.007471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.012399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:26.015696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db3463-8567-4280-adb0-eb702e9756de None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.019122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 936/1897] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:26.021533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.022484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.022707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.023007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.023614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.025541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.058699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 962/1898] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:26.062814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.075661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad739544-7a37-45b9-b965-3bbec5eb5ca2 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.166824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.168460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.168904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.169207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.170077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.172534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.227897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 937/1899] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:26 2022] POST /identity/v3/users => generated 298 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:26.231439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.248863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a407e-26e1-41f3-a865-a7958748aaf4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.254437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.255377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.255735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.256112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.256843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.258618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.269758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 963/1900] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:26.274403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.286800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a902b06-4517-4aef-b4af-33e68d13d5d0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.295375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.296118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.296335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.296771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] PATH_INFO: `/v3/projects/9bd2944e096b47ac9c9b34af24ed8c9d/users/33c6756698f0429a9dc7165c2250bd73/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.319050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd2944e096b47ac9c9b34af24ed8c9d, user_id=33c6756698f0429a9dc7165c2250bd73, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.322796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.350374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 938/1901] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:26 2022] PUT /identity/v3/projects/9bd2944e096b47ac9c9b34af24ed8c9d/users/33c6756698f0429a9dc7165c2250bd73/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:26.351490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.363543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc5537-f9c0-4d51-8f37-6d56a922e0f5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.386398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.388111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:26.402469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:26.438867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.439479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.439759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.440031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.440683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.442556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.453598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 964/1902] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:26.458434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.466843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623377d-e635-4e0a-ae12-d9e05730ab5e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.469880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aded23c5-74aa-4edf-b0d2-36fa2ea56cec admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.471425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.472059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.472322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.473172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] PATH_INFO: `/v3/projects/8fcab31249b0428690425d958839f74d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.474328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8fcab31249b0428690425d958839f74d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.475411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6886280-01eb-4a4e-83ff-8b843494dc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.476107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6886280-01eb-4a4e-83ff-8b843494dc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.476226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.476399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6886280-01eb-4a4e-83ff-8b843494dc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.476741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6886280-01eb-4a4e-83ff-8b843494dc5c admin admin] PATH_INFO: `/v3/projects/9bd2944e096b47ac9c9b34af24ed8c9d/users/33c6756698f0429a9dc7165c2250bd73/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.478720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6886280-01eb-4a4e-83ff-8b843494dc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bd2944e096b47ac9c9b34af24ed8c9d, user_id=33c6756698f0429a9dc7165c2250bd73, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.481510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6886280-01eb-4a4e-83ff-8b843494dc5c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.501787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 965/1903] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:26 2022] PUT /identity/v3/projects/9bd2944e096b47ac9c9b34af24ed8c9d/users/33c6756698f0429a9dc7165c2250bd73/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:26.510248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.510755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.511239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.549139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] MFA Rules not processed for user `33c6756698f0429a9dc7165c2250bd73`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:26.549887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fcab31249b0428690425d958839f74d', 'request_id': 'req-a6cc7165-f8a3-4564-ad35-18a465b0e510'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.551294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:26.560757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fcab31249b0428690425d958839f74d', 'request_id': 'req-a6cc7165-f8a3-4564-ad35-18a465b0e510'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.569061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fcab31249b0428690425d958839f74d', 'request_id': 'req-a6cc7165-f8a3-4564-ad35-18a465b0e510'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.574046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:26.587092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] The token cache is being invalidate because project 8fcab31249b0428690425d958839f74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:26.587274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.587931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.590579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 939/1904] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:26 2022] DELETE /identity/v3/projects/8fcab31249b0428690425d958839f74d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:26.594508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.596622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:26.706782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 966/1905] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:26.716303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:26.718011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:26.726161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc7165-f8a3-4564-ad35-18a465b0e510 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.731711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.732439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.732920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.733325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] PATH_INFO: `/v3/users/87e67343332a4dcf89e99f89caf4e915` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.734603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87e67343332a4dcf89e99f89caf4e915)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.737435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.805617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ded95e-cc8a-42d1-8595-6eed7272a0dc None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:26.810148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87e67343332a4dcf89e99f89caf4e915'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.811010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:26.811702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:26.812049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:26.812415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:26.818510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87e67343332a4dcf89e99f89caf4e915'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.819553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87e67343332a4dcf89e99f89caf4e915'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.823068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:26.825866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:26.837890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87e67343332a4dcf89e99f89caf4e915'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.838727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87e67343332a4dcf89e99f89caf4e915'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:26.845020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 967/1906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:26.868613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 940/1907] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:26 2022] DELETE /identity/v3/users/87e67343332a4dcf89e99f89caf4e915 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:27.011850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:27.025769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8b208-e45b-469b-af98-f546093f1c66 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:27.087425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:27.112007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:27.112007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:27.112007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:27.112007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:27.113991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:27.207378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:27.209586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6620476-c0ca-45d3-9e55-274caf8ae92c service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:27.227175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 968/1908] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:27.361732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:27.363349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:27.527182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d59fa5-ceed-40a7-b332-6ab2d4bf3f42 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:27.534156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:27.534857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:27.535915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:27.536209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] PATH_INFO: `/v3/projects/75139b74adf345b097f435b7b65f65e3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:27.537637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75139b74adf345b097f435b7b65f65e3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:27.540961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:27.576744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:27.626579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75139b74adf345b097f435b7b65f65e3', 'request_id': 'req-c4a91804-8bad-4ce0-b695-02d07a4c4670'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:27.635879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75139b74adf345b097f435b7b65f65e3', 'request_id': 'req-c4a91804-8bad-4ce0-b695-02d07a4c4670'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:27.661038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75139b74adf345b097f435b7b65f65e3', 'request_id': 'req-c4a91804-8bad-4ce0-b695-02d07a4c4670'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:27.676872 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] The token cache is being invalidate because project 75139b74adf345b097f435b7b65f65e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:27.677399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:27.678288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c4a91804-8bad-4ce0-b695-02d07a4c4670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:27.680194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 941/1909] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:27 2022] DELETE /identity/v3/projects/75139b74adf345b097f435b7b65f65e3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:27.685025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:27.685884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:27.686311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:27.730847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:27.754997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:27.933410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 969/1910] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:27.941433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:27.943666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:27.943962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:27.998898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:28.000138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:28.027245 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 942/1911] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:28.028785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.046921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d86cd1-a84d-494f-be79-add5bce63ef1 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.060937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.061847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.062178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.062461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.063129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:28.063435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.067472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.105753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 970/1912] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:28.109732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.121351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9155a185-8c69-445f-8325-3ba89be47827 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.127152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.129456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.129868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.130336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.131003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.132930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.167936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 943/1913] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:28 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:28.172098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.184192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac32f2-bcd9-4dfb-9506-4c0ca418bb9f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.254492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.254997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.255283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.258050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.258800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.261444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.287142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 971/1914] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:28 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:28.288502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.298935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2efa8-7b37-4c72-93fa-7f24b847d131 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.304696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.305322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.305584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.305895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.306557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.308270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.319613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 944/1915] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:28.324735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.336391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746db824-7a86-4852-b672-a0452dd26761 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.341126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753abfe-56e0-478f-933b-1e6e36323c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.341750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753abfe-56e0-478f-933b-1e6e36323c50 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.342032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753abfe-56e0-478f-933b-1e6e36323c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.342333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753abfe-56e0-478f-933b-1e6e36323c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.343014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753abfe-56e0-478f-933b-1e6e36323c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.344638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753abfe-56e0-478f-933b-1e6e36323c50 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.351566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:28.357754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 972/1916] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:28.362107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.373168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388d1d4-77ab-411a-a3cc-fb358292e2c3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.377619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.378314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.378596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.378977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] PATH_INFO: `/v3/projects/0745929ebbe3418ebab053c3600f5042/users/629036489b3940349dfdc66abfa6bea2/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.393559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0745929ebbe3418ebab053c3600f5042, user_id=629036489b3940349dfdc66abfa6bea2, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.396461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.412267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 945/1917] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:28 2022] PUT /identity/v3/projects/0745929ebbe3418ebab053c3600f5042/users/629036489b3940349dfdc66abfa6bea2/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:28.423561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.423946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.424284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.453461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] MFA Rules not processed for user `629036489b3940349dfdc66abfa6bea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:28.454705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:28.548195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 973/1918] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:28.553449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.636065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc6b802-837d-45c0-bbb5-27414551efa0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.640945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.641580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.641899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.642174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.642824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.645691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.681243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 946/1919] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:28 2022] POST /identity/v3/projects => generated 381 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:28.685260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.698914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9e0b3-83c6-4742-868b-1b496e915e57 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.762589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.763215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.763503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.763785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.764445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.766494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.797196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 974/1920] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:28 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:28.799374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.811380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ffa4a-981d-4767-8f18-05724c7aa6ce admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.816847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.817486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.817773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.818105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.818770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.820616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.837861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 947/1921] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:28.839417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.850719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42946aa-cb30-4ff1-a56f-a9faf45010b3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.856436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:28.857110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:28.857391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:28.857804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] PATH_INFO: `/v3/projects/d919dd77aeb142098eab24198a774f13/users/3080542a6241491a96a644ed4deafc7b/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:28.886490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=d919dd77aeb142098eab24198a774f13, user_id=3080542a6241491a96a644ed4deafc7b, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:28.886490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:28.905842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 975/1922] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:28 2022] PUT /identity/v3/projects/d919dd77aeb142098eab24198a774f13/users/3080542a6241491a96a644ed4deafc7b/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:28.909553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:28.929850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11d6ed-dbbe-4c44-ae29-6151513cce17 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:28.940683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:29.000866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d6ac0a-bc9f-4753-b327-6d6f5441d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:29.001586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ac0a-bc9f-4753-b327-6d6f5441d0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:29.001897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ac0a-bc9f-4753-b327-6d6f5441d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:29.002567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d6ac0a-bc9f-4753-b327-6d6f5441d0ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:29.003235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ac0a-bc9f-4753-b327-6d6f5441d0ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:29.004938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d6ac0a-bc9f-4753-b327-6d6f5441d0ef admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:29.015923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 948/1923] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:29.020370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:29.033186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e43ea6-36ab-46de-8cc6-e89bd9f9e9db admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:29.040652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:29.041337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:29.041621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:29.041948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] PATH_INFO: `/v3/projects/d919dd77aeb142098eab24198a774f13/users/3080542a6241491a96a644ed4deafc7b/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:29.043898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d919dd77aeb142098eab24198a774f13, user_id=3080542a6241491a96a644ed4deafc7b, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:29.046594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:29.058520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 976/1924] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:29 2022] PUT /identity/v3/projects/d919dd77aeb142098eab24198a774f13/users/3080542a6241491a96a644ed4deafc7b/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:29.069142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:29.069453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:29.069734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:29.112811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] MFA Rules not processed for user `3080542a6241491a96a644ed4deafc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:29.114074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:29.189130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 949/1925] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:29 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:29.209016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:29.210933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:29.261935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:29.276974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271562b5-fc19-44c6-b5eb-019a373b7fff admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:29.281968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:29.282873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:29.283152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:29.283478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:29.294468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:29.296030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:29.307479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 977/1926] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:29 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:29.760330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:29.772272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554c3ef-bb88-4462-874a-1d92bcd5b475 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:29.777821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3080542a6241491a96a644ed4deafc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd919dd77aeb142098eab24198a774f13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:29.778586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:29.778940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:29.779170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:29.779844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:29.780161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:29.782489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:29.825013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 950/1927] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:29.829280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:29.842028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b14f2e-0fb7-4e5d-a51a-33656fa6223e service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:29.850524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3080542a6241491a96a644ed4deafc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd919dd77aeb142098eab24198a774f13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:29.851154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:29.851443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:29.851722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:29.852743 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:29.855802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:29.907440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 978/1928] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:29 2022] POST /identity/v3/projects => generated 354 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:29.913449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:29.927879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94249b90-800d-45fb-92fc-e2f7126107c1 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:30.017365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3080542a6241491a96a644ed4deafc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd919dd77aeb142098eab24198a774f13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:30.018870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.020053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.020504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.021489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:30.022239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:30.024235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:30.040043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 951/1929] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:30.099101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:30.114337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2035ac1-a1f0-4465-9f06-967cd36c01f2 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:30.127730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3080542a6241491a96a644ed4deafc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd919dd77aeb142098eab24198a774f13', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:30.129956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.130363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.130836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] PATH_INFO: `/v3/projects/39d98e6cd072445e92bfa881824ac305` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.133285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39d98e6cd072445e92bfa881824ac305)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:30.138056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:30.140202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:30.142063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:30.172622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:30.206982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d98e6cd072445e92bfa881824ac305', 'request_id': 'req-cd4b780b-3534-4108-964f-e200df1148e9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.221180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d98e6cd072445e92bfa881824ac305', 'request_id': 'req-cd4b780b-3534-4108-964f-e200df1148e9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.237505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d98e6cd072445e92bfa881824ac305', 'request_id': 'req-cd4b780b-3534-4108-964f-e200df1148e9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.253304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] The token cache is being invalidate because project 39d98e6cd072445e92bfa881824ac305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:30.254481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.255454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cd4b780b-3534-4108-964f-e200df1148e9 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.258551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 979/1930] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:30 2022] DELETE /identity/v3/projects/39d98e6cd072445e92bfa881824ac305 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:30.273104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1fb36-8d9d-4e74-ba54-5a65d8925921 tempest-VolumeQuotaClassesTest-2111747913 tempest-VolumeQuotaClassesTest-2111747913-project-admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:30.388154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:30.389136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.389444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.390085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] PATH_INFO: `/v3/users/b4280df11eee4c39bd01dbc8a7f39871` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.391670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4280df11eee4c39bd01dbc8a7f39871)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:30.394055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:30.480799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4280df11eee4c39bd01dbc8a7f39871'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.500332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4280df11eee4c39bd01dbc8a7f39871'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.501092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4280df11eee4c39bd01dbc8a7f39871'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.512257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4280df11eee4c39bd01dbc8a7f39871'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.515030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4280df11eee4c39bd01dbc8a7f39871'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.560757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 952/1931] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:30 2022] DELETE /identity/v3/users/b4280df11eee4c39bd01dbc8a7f39871 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:30.565672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.565984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.566925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.600215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:30.602008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:30.620836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:30.622322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:30.688349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 980/1932] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:30.693411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:30.721110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98705ea4-9ecd-4c83-9d47-1b78584394c8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:30.724298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:30.728272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:30.729102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.729644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.729644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] PATH_INFO: `/v3/users/629036489b3940349dfdc66abfa6bea2` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.730642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:30.731961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=629036489b3940349dfdc66abfa6bea2)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:30.733740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:30.806607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:30.812887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b52db0-d067-4680-966e-ff4e811cc188 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:30.819034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '629036489b3940349dfdc66abfa6bea2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.834770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '629036489b3940349dfdc66abfa6bea2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.835040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832a119-28ec-49b7-814f-38f8312e0fe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:30.836277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832a119-28ec-49b7-814f-38f8312e0fe9 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.836605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '629036489b3940349dfdc66abfa6bea2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.836884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832a119-28ec-49b7-814f-38f8312e0fe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.838057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832a119-28ec-49b7-814f-38f8312e0fe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.852448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '629036489b3940349dfdc66abfa6bea2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.853595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '629036489b3940349dfdc66abfa6bea2'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:30.879927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832a119-28ec-49b7-814f-38f8312e0fe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:30.884522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832a119-28ec-49b7-814f-38f8312e0fe9 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:30.898423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 981/1933] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:30.901785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 953/1934] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:30 2022] DELETE /identity/v3/users/629036489b3940349dfdc66abfa6bea2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:30.905575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:30.905992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:30.906372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:30.932086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:30.933559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:31.017745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 982/1935] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:31.120684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:31.122888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:31.214556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5e661-2f69-4d03-92a7-422352019466 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:31.223304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:31.224598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:31.225006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:31.225840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:31.242481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:31.244246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:31.265844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 954/1936] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:32.167688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:32.169556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:32.199734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36861cc3-478e-416a-ade8-5f47176b661b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:32.209595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:32.210490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:32.211079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:32.211444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] PATH_INFO: `/v3/projects/edde214edf5e499fa2e14441681d7078` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:32.213680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=edde214edf5e499fa2e14441681d7078)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:32.216034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:32.282117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edde214edf5e499fa2e14441681d7078', 'request_id': 'req-4de945b0-2e69-439c-89e0-298a35d27a7f'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.290241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edde214edf5e499fa2e14441681d7078', 'request_id': 'req-4de945b0-2e69-439c-89e0-298a35d27a7f'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.298266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edde214edf5e499fa2e14441681d7078', 'request_id': 'req-4de945b0-2e69-439c-89e0-298a35d27a7f'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.312075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] The token cache is being invalidate because project edde214edf5e499fa2e14441681d7078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:32.312485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.313315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.315620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 983/1937] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:32 2022] DELETE /identity/v3/projects/edde214edf5e499fa2e14441681d7078 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:32.322285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:32.348737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a3bd05-9802-4915-aa75-0d550bab82a5 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:32.433299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:32.434751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:32.435038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:32.435356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] PATH_INFO: `/v3/users/33c6756698f0429a9dc7165c2250bd73` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:32.437341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33c6756698f0429a9dc7165c2250bd73)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:32.439376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:32.446870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:32.502567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33c6756698f0429a9dc7165c2250bd73'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.510877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33c6756698f0429a9dc7165c2250bd73'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.511578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33c6756698f0429a9dc7165c2250bd73'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.520287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33c6756698f0429a9dc7165c2250bd73'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.521157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33c6756698f0429a9dc7165c2250bd73'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.534746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:32.537094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:32.543912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 955/1938] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:32 2022] DELETE /identity/v3/users/33c6756698f0429a9dc7165c2250bd73 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:32.566126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de945b0-2e69-439c-89e0-298a35d27a7f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:32.673167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:32.674302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:32.674795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:32.675290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] PATH_INFO: `/v3/projects/0745929ebbe3418ebab053c3600f5042` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:32.677113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0745929ebbe3418ebab053c3600f5042)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:32.679186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:32.706586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:32.768221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0745929ebbe3418ebab053c3600f5042', 'request_id': 'req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.778499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0745929ebbe3418ebab053c3600f5042', 'request_id': 'req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.790673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0745929ebbe3418ebab053c3600f5042', 'request_id': 'req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.803838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] The token cache is being invalidate because project 0745929ebbe3418ebab053c3600f5042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:32.804139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.804861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.810061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 984/1939] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:32 2022] DELETE /identity/v3/projects/0745929ebbe3418ebab053c3600f5042 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:32.811511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:32.813605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:32.830435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b42dc-a844-48c3-baf5-0b130e584024 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:32.887235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:32.888811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:32.924486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:32.926493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:32.926844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:32.927231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] PATH_INFO: `/v3/users/3080542a6241491a96a644ed4deafc7b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:32.928520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] RBAC: Authorizing `identity:delete_user(user_id=3080542a6241491a96a644ed4deafc7b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:32.931455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:32.989083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5ed24-e1b3-4a47-a12e-8f852211d62b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:32.992526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3080542a6241491a96a644ed4deafc7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:32.994152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:32.994867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:32.995215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:32.995566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] PATH_INFO: `/v3/projects/9bd2944e096b47ac9c9b34af24ed8c9d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:32.996819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bd2944e096b47ac9c9b34af24ed8c9d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:32.998863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.000223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3080542a6241491a96a644ed4deafc7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.001070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3080542a6241491a96a644ed4deafc7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.010166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3080542a6241491a96a644ed4deafc7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.011071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6b6d3012-a12c-4e83-995c-cda9584b7cea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3080542a6241491a96a644ed4deafc7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.047429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 956/1940] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:32 2022] DELETE /identity/v3/users/3080542a6241491a96a644ed4deafc7b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:33.072010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bd2944e096b47ac9c9b34af24ed8c9d', 'request_id': 'req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.081250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bd2944e096b47ac9c9b34af24ed8c9d', 'request_id': 'req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.089878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bd2944e096b47ac9c9b34af24ed8c9d', 'request_id': 'req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.101247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] The token cache is being invalidate because project 9bd2944e096b47ac9c9b34af24ed8c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:33.101541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.102254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f0a3d62-1b35-41f1-beb7-a4221c1b7005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.103809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 985/1941] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:32 2022] DELETE /identity/v3/projects/9bd2944e096b47ac9c9b34af24ed8c9d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:33.108867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.109355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.109632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.123110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:33.139035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:33.141694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.215438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 957/1942] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:33.226756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.227269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.227483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.259290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:33.260528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.268497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 986/1943] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:33.273075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.283160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2933c-4f1b-42b4-b332-cd409c46470e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.288656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.289198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.289484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.289790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.290457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:33.290771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.292383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.305170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 958/1944] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:33.309646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.320496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c32fb5-8cdb-4c20-801a-1d5d7586f1e8 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.343406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.344203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.344697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.345804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.346665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.349621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.393772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 987/1945] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:33.395700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.409048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27538e58-d585-46ab-97b6-03f4563492b3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.433467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.435789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.444513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:33.514839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.515461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.515804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.516299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.518790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.523677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03715626-f80a-45b4-bdcc-430dec6b310f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.529430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.530301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.530694 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.531091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] PATH_INFO: `/v3/projects/d919dd77aeb142098eab24198a774f13` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.532362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d919dd77aeb142098eab24198a774f13)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.534438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.535621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.564888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 959/1946] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:33.565738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.577545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f49fa3-80ca-47c7-9af7-aa209a3c2d9b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.582913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.583773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.584129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.584417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.585371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.587005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.599443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd919dd77aeb142098eab24198a774f13', 'request_id': 'req-787e2698-9838-4c98-a0b0-84c691dbb0b5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.599982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 960/1947] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:33.603944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.614448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd919dd77aeb142098eab24198a774f13', 'request_id': 'req-787e2698-9838-4c98-a0b0-84c691dbb0b5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.616098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d718818-347d-49d7-aaf6-687910a820ad admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.622807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd919dd77aeb142098eab24198a774f13', 'request_id': 'req-787e2698-9838-4c98-a0b0-84c691dbb0b5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.634908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] The token cache is being invalidate because project d919dd77aeb142098eab24198a774f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:33.635239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.635866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-787e2698-9838-4c98-a0b0-84c691dbb0b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:33.637643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 988/1948] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:33 2022] DELETE /identity/v3/projects/d919dd77aeb142098eab24198a774f13 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:33.642295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736729ee-d2d2-4f4d-9575-9908ec1d8844 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.642584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736729ee-d2d2-4f4d-9575-9908ec1d8844 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.642865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736729ee-d2d2-4f4d-9575-9908ec1d8844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.664861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-736729ee-d2d2-4f4d-9575-9908ec1d8844 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:33.666724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-736729ee-d2d2-4f4d-9575-9908ec1d8844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.690960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.691568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.691876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.692194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.692807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.694506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.707999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 961/1949] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:33.713144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.715138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.725878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:33.731997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab6b65-b275-49a6-8014-d323845a2e88 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.745559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d6440-9203-4c78-95a1-94dc4e04948c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.746396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d6440-9203-4c78-95a1-94dc4e04948c admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.746748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d6440-9203-4c78-95a1-94dc4e04948c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.747099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d6440-9203-4c78-95a1-94dc4e04948c admin admin] PATH_INFO: `/v3/projects/3fbf18224dce402f8c316ee7e7017da8/users/1de1bd6ad105445f82312f375a9f01de/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.748511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 989/1950] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:33.756150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.756445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.757161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.763388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d6440-9203-4c78-95a1-94dc4e04948c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fbf18224dce402f8c316ee7e7017da8, user_id=1de1bd6ad105445f82312f375a9f01de, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.766105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d6440-9203-4c78-95a1-94dc4e04948c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.778627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:33.779862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.781027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 962/1951] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:33 2022] PUT /identity/v3/projects/3fbf18224dce402f8c316ee7e7017da8/users/1de1bd6ad105445f82312f375a9f01de/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:33.793266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.793556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.793866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.812798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:33.825243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] MFA Rules not processed for user `1de1bd6ad105445f82312f375a9f01de`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:33.826647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:33.847889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 990/1952] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:33.851834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.861353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c528-a8ef-41f5-a34c-06e6c6b226d1 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.867036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.867782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.868000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.868360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.869039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:33.869423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.871251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.884633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 991/1953] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:33.889520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.899033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 963/1954] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:33.899796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6b9e0-3c13-4532-8d3c-724d9d7354d6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.903209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.905928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.907071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.907586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.908104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.909294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.916260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.929842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a352d-3ede-4c4e-bfb5-e135875cf6ba None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:33.935408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:33.936033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:33.936324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:33.936603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:33.937252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:33.939412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:33.949772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 992/1955] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/projects => generated 391 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:33.953081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:33.971101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 964/1956] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/projects => generated 367 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:33.972329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.017954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42fb5a4-1fef-4e93-b6cf-a4c93cd201cf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.038166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a799b-71b7-41cf-9d65-c00d4178cca5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.042885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.043489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.043770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.044043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.044681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.046657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.068883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 965/1957] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:34.072707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.077801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.078416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.078697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.078971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.079603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.082619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.083015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba6344-2e24-4299-878f-fca734c501cf admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.087938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.088604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.088952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.089360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.090162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.091810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.107753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 966/1958] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:34.108539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 993/1959] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:33 2022] POST /identity/v3/users => generated 296 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:34.110569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.110740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.121840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4afb45-407b-46f4-8148-eee14d0e0a41 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.123452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98559aea-3062-45d9-9e79-0c018e3ebaa8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.126511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.127170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.127450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.127723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] PATH_INFO: `/v3/projects/c844ca233b4a45478cfc38baaec43eeb/users/0c4e02cd21f547fe908a27b270bbcd4a/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.128545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.129369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.129973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.130259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.130914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.133262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.146860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 994/1960] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:34.147296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c844ca233b4a45478cfc38baaec43eeb, user_id=0c4e02cd21f547fe908a27b270bbcd4a, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.147296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.150368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.161812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51726685-214f-4a83-8609-74bb0ca98693 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.164443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 967/1961] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:34 2022] PUT /identity/v3/projects/c844ca233b4a45478cfc38baaec43eeb/users/0c4e02cd21f547fe908a27b270bbcd4a/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:34.168487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.174259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:34.189630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:34.232971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.233974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.234315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.234656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.235406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.237049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.243995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cb27-e549-4947-a8a2-60d2b626fd68 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.248900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 995/1962] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:34.250268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.250921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.251741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.251741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.252130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.253190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.254010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.264309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fd35f7-dc06-409e-91d2-90006b42039d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.265950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 968/1963] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:34.270053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.272156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4ff6-af81-41c4-9283-aafa1fb0e3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.272846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4ff6-af81-41c4-9283-aafa1fb0e3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.273130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4ff6-af81-41c4-9283-aafa1fb0e3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.273424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4ff6-af81-41c4-9283-aafa1fb0e3f9 admin admin] PATH_INFO: `/v3/projects/18bc526b19c643b4b40910b5ece735cf/users/d5bf390cfacb44a7b9660c6fcb182e7b/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.281084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4303616e-06de-47e5-8fb6-34ee15ee27ef admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.290271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547577a0-9b8d-4ef9-80e5-533f76510a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.291033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547577a0-9b8d-4ef9-80e5-533f76510a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.291387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547577a0-9b8d-4ef9-80e5-533f76510a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.291732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547577a0-9b8d-4ef9-80e5-533f76510a83 admin admin] PATH_INFO: `/v3/projects/c844ca233b4a45478cfc38baaec43eeb/users/0c4e02cd21f547fe908a27b270bbcd4a/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.293587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4ff6-af81-41c4-9283-aafa1fb0e3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18bc526b19c643b4b40910b5ece735cf, user_id=d5bf390cfacb44a7b9660c6fcb182e7b, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.293825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547577a0-9b8d-4ef9-80e5-533f76510a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c844ca233b4a45478cfc38baaec43eeb, user_id=0c4e02cd21f547fe908a27b270bbcd4a, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.296284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4ff6-af81-41c4-9283-aafa1fb0e3f9 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.296789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547577a0-9b8d-4ef9-80e5-533f76510a83 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.308724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 969/1964] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:34 2022] PUT /identity/v3/projects/c844ca233b4a45478cfc38baaec43eeb/users/0c4e02cd21f547fe908a27b270bbcd4a/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:34.317853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 996/1965] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:34 2022] PUT /identity/v3/projects/18bc526b19c643b4b40910b5ece735cf/users/d5bf390cfacb44a7b9660c6fcb182e7b/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:34.319551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.319947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.320341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.321658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.321988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.322267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.351067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] MFA Rules not processed for user `0c4e02cd21f547fe908a27b270bbcd4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:34.352284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:34.362113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] MFA Rules not processed for user `d5bf390cfacb44a7b9660c6fcb182e7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:34.363908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:34.438564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 970/1966] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:34.449089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 997/1967] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:34.453800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.454182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.455978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:34.531415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e32c01-05c8-4f40-8856-bcd9ca646af3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.532163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cfc4ef-d619-46a6-a56b-461e6cfd7c7b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.535844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.536546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.536985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.537260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.538361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.538977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.539260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.539534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.540212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.542484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.548216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.550013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.559489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:34.564688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 998/1968] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:34.585890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 971/1969] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:34 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:34.586115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.594240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c06671-c280-43b1-b040-dc497c4d32f1 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.630594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:34.665498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.670975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.672111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.672402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.672863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.673509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.675465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.697933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 999/1970] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:34 2022] POST /identity/v3/users => generated 302 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:34.701809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.712765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fe972-69c8-48a5-8400-72c2e647c6d6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.720218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.720866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.721142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.721432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.722133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.724396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.733959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620e226f-9c3c-4da9-87b2-881e0af88a8c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.738430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1000/1971] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:34.738567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.739070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.739331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.739442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.739791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.752196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfa670-bc7a-4f07-ab0b-d7fc35202a53 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.759043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.759971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.760323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.760669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] PATH_INFO: `/v3/projects/7bb4f4b9ad314deebe092d98fbd9ed06/users/a04486cfa677491898752b25d3b02c5d/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.778958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb4f4b9ad314deebe092d98fbd9ed06, user_id=a04486cfa677491898752b25d3b02c5d, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.782115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.804512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1001/1972] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:34 2022] PUT /identity/v3/projects/7bb4f4b9ad314deebe092d98fbd9ed06/users/a04486cfa677491898752b25d3b02c5d/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:34.805671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.829497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.831373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.845663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 972/1973] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:34.893380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b94d14-fd7f-45c9-9604-334d92ed9e2a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.902092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348aba3a-43be-4c36-8526-83bd05ad1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.902812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aba3a-43be-4c36-8526-83bd05ad1666 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.904439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aba3a-43be-4c36-8526-83bd05ad1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.904802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348aba3a-43be-4c36-8526-83bd05ad1666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.906782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aba3a-43be-4c36-8526-83bd05ad1666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.908155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348aba3a-43be-4c36-8526-83bd05ad1666 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.937168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1002/1974] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:34.939242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:34.953292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c74f1-67da-4f4c-943c-2a67fac1a1f8 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:34.959666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:34.961472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.961805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.962088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] PATH_INFO: `/v3/projects/7bb4f4b9ad314deebe092d98fbd9ed06/users/a04486cfa677491898752b25d3b02c5d/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:34.966258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bb4f4b9ad314deebe092d98fbd9ed06, user_id=a04486cfa677491898752b25d3b02c5d, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:34.969230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:34.984610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 973/1975] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:34 2022] PUT /identity/v3/projects/7bb4f4b9ad314deebe092d98fbd9ed06/users/a04486cfa677491898752b25d3b02c5d/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:34.996318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:34.996622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:34.997012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:35.036422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] MFA Rules not processed for user `a04486cfa677491898752b25d3b02c5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:35.037879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:35.136320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1003/1976] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:35.149688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:35.151680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:35.240078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd45c1e-1f41-418a-b868-94af23b0b60e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:35.248183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d862-540e-493e-9314-cf8a91b32348 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:35.249238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d862-540e-493e-9314-cf8a91b32348 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:35.249587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d862-540e-493e-9314-cf8a91b32348 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:35.249947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d862-540e-493e-9314-cf8a91b32348 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:35.263672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d862-540e-493e-9314-cf8a91b32348 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:35.265177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d862-540e-493e-9314-cf8a91b32348 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:35.278873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 974/1977] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:35.341534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:35.352326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17b65b-cfd2-483e-912a-466791060853 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:35.357077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce70249-8213-4cbf-9fed-69d4176ec820 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:35.357929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce70249-8213-4cbf-9fed-69d4176ec820 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:35.358355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce70249-8213-4cbf-9fed-69d4176ec820 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:35.358725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce70249-8213-4cbf-9fed-69d4176ec820 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:35.364249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:35.436587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce70249-8213-4cbf-9fed-69d4176ec820 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:35.438310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce70249-8213-4cbf-9fed-69d4176ec820 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:35.450949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1004/1978] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:39.032576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415933d-1842-4d37-b504-dab4df965e6e None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.033068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415933d-1842-4d37-b504-dab4df965e6e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.033161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415933d-1842-4d37-b504-dab4df965e6e None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.036849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 975/1979] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:16:39 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:16:39.046798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf8674-64a2-415c-825d-94628f587c61 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.047248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf8674-64a2-415c-825d-94628f587c61 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.047413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf8674-64a2-415c-825d-94628f587c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.076940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-daaf8674-64a2-415c-825d-94628f587c61 None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:39.091886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-daaf8674-64a2-415c-825d-94628f587c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.179755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415933d-1842-4d37-b504-dab4df965e6e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:39.181558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d415933d-1842-4d37-b504-dab4df965e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.242137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1005/1980] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:39.265321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9caf2-ba0c-4384-a02e-52779aee219b None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.265875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9caf2-ba0c-4384-a02e-52779aee219b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.266269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9caf2-ba0c-4384-a02e-52779aee219b None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.267697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1006/1981] 10.222.0.43 () {54 vars in 961 bytes} [Tue Aug 30 00:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 30 00:16:39.267957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:39.278161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.278537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.278889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.304755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:39.306876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.311588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415933d-1842-4d37-b504-dab4df965e6e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:39.320471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1007/1982] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Aug 30 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:39.322978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:39.323684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.324054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.324450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] PATH_INFO: `/v3/users/0ba2a01503894fe4be71f54aff8807c5` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.325893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba2a01503894fe4be71f54aff8807c5)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:39.328049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:39.332561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:39.348525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e8e70-3edc-4190-893f-21b798bbeca5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:39.354961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:39.356071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.356476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.356851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.370302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:39.371903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:39.384275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1008/1983] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:39.386079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:39.397723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa931b4-adee-432c-a708-e8537346e503 service placement] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:39.403548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:39.404351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.404723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.405066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] PATH_INFO: `/v3/users/d5bf390cfacb44a7b9660c6fcb182e7b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.406455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bf390cfacb44a7b9660c6fcb182e7b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:39.408807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:39.424550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba2a01503894fe4be71f54aff8807c5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.434194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba2a01503894fe4be71f54aff8807c5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.435495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba2a01503894fe4be71f54aff8807c5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.447100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba2a01503894fe4be71f54aff8807c5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.447882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f82ccccc-dfc2-419e-b21f-1663cd2dc2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba2a01503894fe4be71f54aff8807c5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.469094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 976/1984] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:39 2022] DELETE /identity/v3/users/0ba2a01503894fe4be71f54aff8807c5 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:39.514775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bf390cfacb44a7b9660c6fcb182e7b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.525432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bf390cfacb44a7b9660c6fcb182e7b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.526554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bf390cfacb44a7b9660c6fcb182e7b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.544272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bf390cfacb44a7b9660c6fcb182e7b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.547517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:39.556372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bf390cfacb44a7b9660c6fcb182e7b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.565282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1009/1985] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:39 2022] DELETE /identity/v3/users/d5bf390cfacb44a7b9660c6fcb182e7b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:39.570218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.570218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.570521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.591158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:39.592411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.679724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 977/1986] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:39.683130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:39.684720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.697531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:39.699476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.709449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1692649-d36f-4f51-8c05-dc01f4119e2d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:39.724056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:39.724945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.725225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.725496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] PATH_INFO: `/v3/projects/e4ee33721add4315b74b076f2f536c0f` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.726812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4ee33721add4315b74b076f2f536c0f)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:39.729098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:39.777246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e6597d-d9e2-4b6c-bf98-2bcac5cac444 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:39.786118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4ee33721add4315b74b076f2f536c0f', 'request_id': 'req-a1750ecb-5893-48d5-823e-4a9d5a692039'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.791657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:39.795137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4ee33721add4315b74b076f2f536c0f', 'request_id': 'req-a1750ecb-5893-48d5-823e-4a9d5a692039'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.805378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4ee33721add4315b74b076f2f536c0f', 'request_id': 'req-a1750ecb-5893-48d5-823e-4a9d5a692039'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.819905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] The token cache is being invalidate because project e4ee33721add4315b74b076f2f536c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:39.820200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.820931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a1750ecb-5893-48d5-823e-4a9d5a692039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:39.822524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1010/1987] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:39 2022] DELETE /identity/v3/projects/e4ee33721add4315b74b076f2f536c0f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:39.827833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899cae-e22e-4132-a46c-e97d7c2be81b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.828338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899cae-e22e-4132-a46c-e97d7c2be81b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.828623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899cae-e22e-4132-a46c-e97d7c2be81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.849226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-16899cae-e22e-4132-a46c-e97d7c2be81b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:39.850488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-16899cae-e22e-4132-a46c-e97d7c2be81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.851748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:39.852537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.853114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.853491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.855395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.911164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1011/1988] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:39.919724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.920018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.920297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.923236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:39.924685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:39.935128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 978/1989] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:39.943663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:39.944929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:39.952987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1012/1990] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:39.958207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:39.968271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8b853-de37-46e8-8b50-fc83c6f30e5b service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:39.975243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:39.975869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:39.976622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:39.976903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:39.977569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:39.977930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:39.987592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:39.999798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 979/1991] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:40.001088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.011594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580aae93-4fa4-4b1a-a86c-77ae6610ded5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.017244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.017893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.018173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.018451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.019124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.021684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.058331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1013/1992] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:40 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:40.060349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.071909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909bab0-b9e1-4bd5-a55f-4c18b51726ed admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.149787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.150494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.150977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.151791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.152469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.154450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.168640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.171453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.183363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 980/1993] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:40 2022] POST /identity/v3/users => generated 286 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:40.186724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1092ce-2575-4514-b970-dc168bb6f9ca admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.187263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.191816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.192609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.192979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.193328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] PATH_INFO: `/v3/users/1de1bd6ad105445f82312f375a9f01de` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.195124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de1bd6ad105445f82312f375a9f01de)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.197056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.199984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43838ba0-83d6-4eaf-a0ee-bb3d27a2f4c0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.205643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.206280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.206563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.206867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.207523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.209116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.221727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 981/1994] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:40.226948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.238724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d2caa-2681-4115-b6d5-b87df200a70f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.243880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.244576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.244989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.245256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.246203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.247662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.261751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 982/1995] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:40.261751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.261751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.263114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:40.267889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de1bd6ad105445f82312f375a9f01de'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.275623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6896e-a20d-4ae7-bae6-48e08e8dd8e8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.279782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de1bd6ad105445f82312f375a9f01de'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.280527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de1bd6ad105445f82312f375a9f01de'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.282527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.283237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.283584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.283930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] PATH_INFO: `/v3/projects/18bc526b19c643b4b40910b5ece735cf` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.286449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18bc526b19c643b4b40910b5ece735cf)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.289609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.296623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de1bd6ad105445f82312f375a9f01de'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.305232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de1bd6ad105445f82312f375a9f01de'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.307288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:40.312147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1014/1996] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:40 2022] DELETE /identity/v3/users/1de1bd6ad105445f82312f375a9f01de => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:40.314218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.315188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.343174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18bc526b19c643b4b40910b5ece735cf', 'request_id': 'req-d6bf4701-f551-41d3-9b50-a2b911c0249e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.352844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18bc526b19c643b4b40910b5ece735cf', 'request_id': 'req-d6bf4701-f551-41d3-9b50-a2b911c0249e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.360227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18bc526b19c643b4b40910b5ece735cf', 'request_id': 'req-d6bf4701-f551-41d3-9b50-a2b911c0249e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.371570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] The token cache is being invalidate because project 18bc526b19c643b4b40910b5ece735cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:40.371859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.372524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d6bf4701-f551-41d3-9b50-a2b911c0249e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.374461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 983/1997] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:40 2022] DELETE /identity/v3/projects/18bc526b19c643b4b40910b5ece735cf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:40.375730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.376017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.376296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.386664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eca3c6-cb2e-4bb4-b7cb-978fbbc51222 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.395968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:40.397635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.446612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.447282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.447564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.447866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] PATH_INFO: `/v3/projects/40ded87f29ee4fb8a10806d47d1e8c2f/users/4933c7d8226443508e87c503533c8f5e/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.460181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 984/1998] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:40.461305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.462671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.465474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40ded87f29ee4fb8a10806d47d1e8c2f, user_id=4933c7d8226443508e87c503533c8f5e, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.468195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.476301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc2755-11a6-48b8-9e6e-4fed7d9ff234 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.482385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1015/1999] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:40 2022] PUT /identity/v3/projects/40ded87f29ee4fb8a10806d47d1e8c2f/users/4933c7d8226443508e87c503533c8f5e/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:40.483193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.492826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.547554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.548345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.548679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.548959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] PATH_INFO: `/v3/users/a04486cfa677491898752b25d3b02c5d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.550155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04486cfa677491898752b25d3b02c5d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.555883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.561734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35a4e2-9094-4d6d-8883-db93c110a90a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.565460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb4d01-0376-4784-9463-3e469301e1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.566117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb4d01-0376-4784-9463-3e469301e1dd service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.566576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb4d01-0376-4784-9463-3e469301e1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.566865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb4d01-0376-4784-9463-3e469301e1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.573284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:40.578380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb4d01-0376-4784-9463-3e469301e1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.579916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb4d01-0376-4784-9463-3e469301e1dd service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.596876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1016/2000] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:40.599719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.600207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.600687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.632714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:40.635735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04486cfa677491898752b25d3b02c5d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.645411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] MFA Rules not processed for user `4933c7d8226443508e87c503533c8f5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:40.648214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.648720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04486cfa677491898752b25d3b02c5d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.649536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04486cfa677491898752b25d3b02c5d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.661196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04486cfa677491898752b25d3b02c5d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.662537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04486cfa677491898752b25d3b02c5d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:40.726654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 985/2001] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:40 2022] DELETE /identity/v3/users/a04486cfa677491898752b25d3b02c5d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:40.756889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1017/2002] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:40.770809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:40.772768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:40.885792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6046b1a-d386-49bb-831a-53c0cccf8dd6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:40.892759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:40.893282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:40.893572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:40.894010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:40.961540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:40.963098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:40.972533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 986/2003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:41.098300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.099822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.113621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819ea0-d194-4a60-8410-9b606a31aa67 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.210071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.210520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.211501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.212034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.212855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.213303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] PATH_INFO: `/v3/projects/3fbf18224dce402f8c316ee7e7017da8` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.214818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fbf18224dce402f8c316ee7e7017da8)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.217072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.237378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f228-6407-420a-b40f-f0eed57ac712 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.249011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.249890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.250178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.251108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] PATH_INFO: `/v3/projects/7bb4f4b9ad314deebe092d98fbd9ed06` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.254573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bb4f4b9ad314deebe092d98fbd9ed06)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.256235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.279251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fbf18224dce402f8c316ee7e7017da8', 'request_id': 'req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.287919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fbf18224dce402f8c316ee7e7017da8', 'request_id': 'req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.297269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fbf18224dce402f8c316ee7e7017da8', 'request_id': 'req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.310852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] The token cache is being invalidate because project 3fbf18224dce402f8c316ee7e7017da8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:41.311168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.311828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.313359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1018/2004] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:41 2022] DELETE /identity/v3/projects/3fbf18224dce402f8c316ee7e7017da8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:41.315603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bb4f4b9ad314deebe092d98fbd9ed06', 'request_id': 'req-c351ee6c-8d34-4897-a3ff-784c2225f6f9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.317270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.318685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.320952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:41.326368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bb4f4b9ad314deebe092d98fbd9ed06', 'request_id': 'req-c351ee6c-8d34-4897-a3ff-784c2225f6f9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.334912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:41.336687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bb4f4b9ad314deebe092d98fbd9ed06', 'request_id': 'req-c351ee6c-8d34-4897-a3ff-784c2225f6f9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.363421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] The token cache is being invalidate because project 7bb4f4b9ad314deebe092d98fbd9ed06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:41.363859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.364690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c351ee6c-8d34-4897-a3ff-784c2225f6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.369879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 987/2005] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:41 2022] DELETE /identity/v3/projects/7bb4f4b9ad314deebe092d98fbd9ed06 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:41.371255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc6b9-0b0e-4f7f-98e0-87af9d44d0d0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.371567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc6b9-0b0e-4f7f-98e0-87af9d44d0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.371847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788dc6b9-0b0e-4f7f-98e0-87af9d44d0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.394864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-788dc6b9-0b0e-4f7f-98e0-87af9d44d0d0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:41.396561 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-788dc6b9-0b0e-4f7f-98e0-87af9d44d0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.405384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7ea87-5d59-4a58-9ccc-38f2f33a2357 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.490803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 988/2006] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:41.497032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.497677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.498237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.498496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] PATH_INFO: `/v3/users/0c4e02cd21f547fe908a27b270bbcd4a` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.499662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4e02cd21f547fe908a27b270bbcd4a)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.499769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.500038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.500317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.501678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.521720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:41.523251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.532051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 989/2007] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:41.537798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.547317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63e09b-59a7-4f5b-8e5a-d19b49049aab None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.552650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.553253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.553433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4e02cd21f547fe908a27b270bbcd4a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.553574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.553842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.554502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:41.554812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.556450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.560537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4e02cd21f547fe908a27b270bbcd4a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.561221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4e02cd21f547fe908a27b270bbcd4a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.568658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 990/2008] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:41.572829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.576637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4e02cd21f547fe908a27b270bbcd4a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.582989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81fe9ff-22a1-40f8-818a-2f193cf66ba1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.584718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4e02cd21f547fe908a27b270bbcd4a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:41.587917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.588502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.588789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.589062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.589728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.591635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1019/2009] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:41 2022] DELETE /identity/v3/users/0c4e02cd21f547fe908a27b270bbcd4a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:41.591767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.622545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 991/2010] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:41 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:41.627104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.631537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.681623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:41.708334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01cfac-804b-4889-95af-3360e91aa9f6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.782762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.783718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.783718 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.783952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.785827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.788282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.827428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1020/2011] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:41 2022] POST /identity/v3/users => generated 290 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:41.831526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.845510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d6c07d-8ef7-4e39-a6be-895b9b9596d1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.853332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.854930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.855417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.855928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.857690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.860056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.875344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 992/2012] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:41.877313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.890338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180d5e2-95b6-4d67-af4b-967f54f19137 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.899156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.899931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.900291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.900567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.901304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.903121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.923097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1021/2013] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:41.926271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.927726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:41.931124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:41.945890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a148a-f4c7-476d-a66f-bb154455217d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.949566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4aff7-2abd-4667-945d-36772b1de3cb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:41.957513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.958162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.958446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.958612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b27245-4867-45ec-a6bd-b135637dedf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:41.958697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] PATH_INFO: `/v3/projects/c844ca233b4a45478cfc38baaec43eeb` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.959525 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27245-4867-45ec-a6bd-b135637dedf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:41.959795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27245-4867-45ec-a6bd-b135637dedf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:41.959868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c844ca233b4a45478cfc38baaec43eeb)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.960139 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b27245-4867-45ec-a6bd-b135637dedf7 admin admin] PATH_INFO: `/v3/projects/12fc6d5230ea41609190932836553a6e/users/7f4b4b5ee99d4c1aad21f8f861e04672/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:41.961765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.977242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b27245-4867-45ec-a6bd-b135637dedf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fc6d5230ea41609190932836553a6e, user_id=7f4b4b5ee99d4c1aad21f8f861e04672, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:41.980150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b27245-4867-45ec-a6bd-b135637dedf7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:41.994591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 993/2014] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:41 2022] PUT /identity/v3/projects/12fc6d5230ea41609190932836553a6e/users/7f4b4b5ee99d4c1aad21f8f861e04672/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:42.011041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.011256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.011536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.016618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c844ca233b4a45478cfc38baaec43eeb', 'request_id': 'req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:42.025222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c844ca233b4a45478cfc38baaec43eeb', 'request_id': 'req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:42.032512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c844ca233b4a45478cfc38baaec43eeb', 'request_id': 'req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:42.039893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] MFA Rules not processed for user `7f4b4b5ee99d4c1aad21f8f861e04672`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:42.041195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.043454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] The token cache is being invalidate because project c844ca233b4a45478cfc38baaec43eeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:42.043745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:42.044405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-74f2f9b9-d993-4365-8836-7d33cf0e5dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:42.045962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1022/2015] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:41 2022] DELETE /identity/v3/projects/c844ca233b4a45478cfc38baaec43eeb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:42.052141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54510b6-aa98-49f1-a27f-b0b1f8d78628 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.052428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54510b6-aa98-49f1-a27f-b0b1f8d78628 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.052702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54510b6-aa98-49f1-a27f-b0b1f8d78628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.072972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f54510b6-aa98-49f1-a27f-b0b1f8d78628 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:42.074199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f54510b6-aa98-49f1-a27f-b0b1f8d78628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.099891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:42.110472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 994/2016] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:42.115190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.117210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.118846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:42.137744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1023/2017] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:42.146165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.146511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.146793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.168714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:42.169947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.180002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1024/2018] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:42.184056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.187367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab785ee7-b0ee-4bba-b916-b71623075131 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.192611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.193253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.193541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.193852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.194098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57996187-5a73-476e-b4ca-a1236bb59a9e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.194499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.196448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.201852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.202633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.202909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.203175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.203818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:42.204128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.205696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.221674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1025/2019] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:42.223375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.228332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 995/2020] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:42.232468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.234157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a8766-18ed-47bc-b3c8-8ee427e6ad00 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.297524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.298404 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.298688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.298967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.299604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.301553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.303180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953700c-4e35-474c-99e5-8b469e1d8289 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.308431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.309242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.309728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.310153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.310936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.313203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.338033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1026/2021] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:42.340240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.341589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 996/2022] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:42.345935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.355914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d6f41-2691-4213-ae06-5b051570057e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.405784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e8c029-e02f-497c-a8f2-fe9ba8506840 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.410793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.411402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.411690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.411967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.412608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.414239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.414576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.414931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.415214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.415583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.416281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.417897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.429601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 997/2023] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:42.433525 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.438286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1027/2024] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:42.442789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.445276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925d271-609d-4fe5-9706-0506cd32c8b7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.450072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.450675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.450962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.451241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.451888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.453485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.453978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf9bca-fceb-4efa-867d-d5ee35dd1eaa admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.454884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:42.459862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.460782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.460907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.461180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.462069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.463737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.466551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 998/2025] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:42.470455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.477210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1028/2026] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:42.478432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.480208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457d43-e960-4a93-a319-13051df64ab0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.484850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1b0e0-f1a4-47ce-98d9-597cb1ab0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.485492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b0e0-f1a4-47ce-98d9-597cb1ab0616 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.485809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b0e0-f1a4-47ce-98d9-597cb1ab0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.486087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1b0e0-f1a4-47ce-98d9-597cb1ab0616 admin admin] PATH_INFO: `/v3/projects/0e9075552d4f476e8c2ae79e2ae643e2/users/1e66864a9d7c4f56bb8e544d8eb373e4/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.489099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11cca83-da60-4f14-b079-08b732983df5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.494884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.495673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.495808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.496027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.498774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.498774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.508330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b0e0-f1a4-47ce-98d9-597cb1ab0616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9075552d4f476e8c2ae79e2ae643e2, user_id=1e66864a9d7c4f56bb8e544d8eb373e4, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.511018 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1b0e0-f1a4-47ce-98d9-597cb1ab0616 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.513211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1029/2027] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:42.517156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.528633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473ea44-cb9c-4b6b-b8a3-3697f2c84040 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.530653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 999/2028] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:42 2022] PUT /identity/v3/projects/0e9075552d4f476e8c2ae79e2ae643e2/users/1e66864a9d7c4f56bb8e544d8eb373e4/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:42.540748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.541105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.541453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.555687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:42.573852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] MFA Rules not processed for user `1e66864a9d7c4f56bb8e544d8eb373e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:42.574777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.603574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012f287-6344-4f8a-9ace-940b21a2d65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.604315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f287-6344-4f8a-9ace-940b21a2d65f admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.604678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f287-6344-4f8a-9ace-940b21a2d65f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.604971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012f287-6344-4f8a-9ace-940b21a2d65f admin admin] PATH_INFO: `/v3/projects/269bc19a24f24c83b001ca6a04dfd2ea/users/ddd39a8d2d794919bde46ed11b6c7494/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.622079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f287-6344-4f8a-9ace-940b21a2d65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=269bc19a24f24c83b001ca6a04dfd2ea, user_id=ddd39a8d2d794919bde46ed11b6c7494, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.628604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012f287-6344-4f8a-9ace-940b21a2d65f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.645676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1030/2029] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:42 2022] PUT /identity/v3/projects/269bc19a24f24c83b001ca6a04dfd2ea/users/ddd39a8d2d794919bde46ed11b6c7494/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:42.653575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1000/2030] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:42.658110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.658591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.658829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.659110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.669543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba990e3-7116-43ab-8397-5f79a2958d2b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.689870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] MFA Rules not processed for user `ddd39a8d2d794919bde46ed11b6c7494`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:42.691154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.743824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.744443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.745381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.745671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.746366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.748275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.778125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1031/2031] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:42.784084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1001/2032] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:42.787567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.790662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.792328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:42.798568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0870161b-8030-4bb7-9b9c-21652bac3351 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.849160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:42.854545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39649b24-e90d-49cb-8485-afc0899d6391 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.859495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.859668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.860103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.860226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.860396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.860525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.860713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.860822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.861430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.864389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.889750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1032/2033] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:42 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:42.893405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.904303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ddfae2-123a-40a1-bd82-a112cf6ccd2d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.909039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.909631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.909974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.910256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.911157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.917217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.930908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1033/2034] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:42.932089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.933611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.935596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:42.944163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1002/2035] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:42.949287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b18eef2-0372-423e-a40e-9bd546d9b1b1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:42.954183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:42.954846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:42.955140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:42.955424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] PATH_INFO: `/v3/projects/d10513e0cd574340819c9c125acd32f6/users/b76984c0a6314ccf8334fd2fe7a5fc26/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:42.967683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:42.975281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10513e0cd574340819c9c125acd32f6, user_id=b76984c0a6314ccf8334fd2fe7a5fc26, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:42.979007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:42.998711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1034/2036] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:42 2022] PUT /identity/v3/projects/d10513e0cd574340819c9c125acd32f6/users/b76984c0a6314ccf8334fd2fe7a5fc26/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:43.002512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:43.017501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55080e80-f6b9-4cae-8715-f7c9c8a92e25 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:43.090959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd466-7c99-4ef9-8e82-31cfce833405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:43.091732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd466-7c99-4ef9-8e82-31cfce833405 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:43.092019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd466-7c99-4ef9-8e82-31cfce833405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:43.092713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd466-7c99-4ef9-8e82-31cfce833405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:43.092939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd466-7c99-4ef9-8e82-31cfce833405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:43.094593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd466-7c99-4ef9-8e82-31cfce833405 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:43.107136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1003/2037] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:43.110966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:43.124400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8379ee7-c6f7-48b2-bc5c-2f9e3e6d067f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:43.131735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:43.132806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:43.133163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:43.133512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] PATH_INFO: `/v3/projects/d10513e0cd574340819c9c125acd32f6/users/b76984c0a6314ccf8334fd2fe7a5fc26/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:43.135814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d10513e0cd574340819c9c125acd32f6, user_id=b76984c0a6314ccf8334fd2fe7a5fc26, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:43.138785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:43.154091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1035/2038] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:43 2022] PUT /identity/v3/projects/d10513e0cd574340819c9c125acd32f6/users/b76984c0a6314ccf8334fd2fe7a5fc26/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:43.167238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:43.167611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:43.167956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:43.203551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] MFA Rules not processed for user `b76984c0a6314ccf8334fd2fe7a5fc26`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:43.204894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:43.295348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1004/2039] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:43.318741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:43.390786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1265508-5f51-4645-ae68-a78e289b5541 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:43.395145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:43.396086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:43.396374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:43.396650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:43.407262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:43.408733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:43.421529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1036/2040] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:43.495215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:43.506212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e130b4-e196-4f08-98e2-727a837471f9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:43.510075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1932019a-f749-4e8f-8a8c-45667129f9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:43.510555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932019a-f749-4e8f-8a8c-45667129f9ab service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:43.510842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932019a-f749-4e8f-8a8c-45667129f9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:43.511109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932019a-f749-4e8f-8a8c-45667129f9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:43.536928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:43.582351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932019a-f749-4e8f-8a8c-45667129f9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:43.583871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1932019a-f749-4e8f-8a8c-45667129f9ab service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:43.593096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1005/2041] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:43.828533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:43.830205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:43.921284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb8228-f6f8-4836-bfa3-e6687c849665 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:43.930150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:43.930889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:43.931246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:43.932046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] PATH_INFO: `/v3/users/4933c7d8226443508e87c503533c8f5e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:43.933018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4933c7d8226443508e87c503533c8f5e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:43.934935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:43.991601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4933c7d8226443508e87c503533c8f5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:43.998494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4933c7d8226443508e87c503533c8f5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:43.999213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4933c7d8226443508e87c503533c8f5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.016013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4933c7d8226443508e87c503533c8f5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.024405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4933c7d8226443508e87c503533c8f5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.026135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:44.033856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1037/2042] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:43 2022] DELETE /identity/v3/users/4933c7d8226443508e87c503533c8f5e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:44.038698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.038989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.039290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.058391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:44.059610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:44.119757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1006/2043] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:44.130202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:44.131651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:44.193373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae8db-4e7a-485c-ae90-b7cdbe2adf5f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:44.197194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51794fad-96b2-4779-a1e1-3b93d308110b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:44.197824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794fad-96b2-4779-a1e1-3b93d308110b service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.198104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794fad-96b2-4779-a1e1-3b93d308110b service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.198376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51794fad-96b2-4779-a1e1-3b93d308110b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.207558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51794fad-96b2-4779-a1e1-3b93d308110b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:44.208957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51794fad-96b2-4779-a1e1-3b93d308110b service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:44.218227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1038/2044] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:44.509531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:44.511726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:44.529490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803f73d-c093-4f7b-9f57-f475eb0099df None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:44.536687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:44.537619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.538020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.538475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] PATH_INFO: `/v3/projects/40ded87f29ee4fb8a10806d47d1e8c2f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.539991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40ded87f29ee4fb8a10806d47d1e8c2f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:44.542929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:44.605371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40ded87f29ee4fb8a10806d47d1e8c2f', 'request_id': 'req-1d7e3377-6006-4687-9158-229adee5b275'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.617569 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40ded87f29ee4fb8a10806d47d1e8c2f', 'request_id': 'req-1d7e3377-6006-4687-9158-229adee5b275'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.627256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40ded87f29ee4fb8a10806d47d1e8c2f', 'request_id': 'req-1d7e3377-6006-4687-9158-229adee5b275'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.642983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] The token cache is being invalidate because project 40ded87f29ee4fb8a10806d47d1e8c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:44.643341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.645030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1d7e3377-6006-4687-9158-229adee5b275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:44.647006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1007/2045] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:44 2022] DELETE /identity/v3/projects/40ded87f29ee4fb8a10806d47d1e8c2f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:44.653757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.654076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.654380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.675197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:44.676577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:44.745611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1039/2046] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:44.753301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.754366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.754964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.776812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:44.778114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:44.786773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1008/2047] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:44.791213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:44.801182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfea46-eea4-429d-af3a-5a69b593596a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:44.806577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:44.807375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.807667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.807945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.808750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:44.809106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:44.811073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:44.825818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1040/2048] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:44.830364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:44.840877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da1b154-1915-4992-847d-851d37b5fb67 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:44.845660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:44.846292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.846575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.846848 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.847510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:44.849539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:44.881069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1009/2049] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:44 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:44.882785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:44.893081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5508095-f9a6-4c3b-9786-5fcaafe1e875 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:44.957781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:44.958674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:44.958979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:44.959242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:44.959707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:44.959879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:44.961503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:44.961810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:44.983825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:44.987887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1041/2050] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:44 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:44.992447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:45.004917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c042c-8b42-4362-bd3f-fcda3c9e9cd8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:45.010730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:45.011329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.011610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.011986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.012648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:45.014285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:45.029910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1042/2051] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:45.031088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:45.041039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54e9b-46de-4f4d-a9b3-07d300ef75db admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:45.042734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c125dc-5009-4c37-945f-54877b183ed9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:45.045980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:45.046740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.047086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.047423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.047825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:45.048216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:45.048646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.049233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.049515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.050090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:45.052093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:45.052515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:45.067834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1043/2052] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:45.069244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:45.080005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce161ca-0556-4bb7-873f-5700e7b0ed48 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:45.085094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7791904b-a5eb-4f7e-8618-d7ea0c450d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:45.085980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791904b-a5eb-4f7e-8618-d7ea0c450d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.086397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791904b-a5eb-4f7e-8618-d7ea0c450d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.086833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7791904b-a5eb-4f7e-8618-d7ea0c450d5e admin admin] PATH_INFO: `/v3/projects/68550fa64d3d4ce2b1ad69ec72f3f43c/users/f0c42850d35549ee806b96f027c05634/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.102736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791904b-a5eb-4f7e-8618-d7ea0c450d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68550fa64d3d4ce2b1ad69ec72f3f43c, user_id=f0c42850d35549ee806b96f027c05634, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:45.105607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7791904b-a5eb-4f7e-8618-d7ea0c450d5e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:45.121981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1044/2053] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:45 2022] PUT /identity/v3/projects/68550fa64d3d4ce2b1ad69ec72f3f43c/users/f0c42850d35549ee806b96f027c05634/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:45.134070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.134726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.134726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.135532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:45.137880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:45.152170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1010/2054] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:45.173755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] MFA Rules not processed for user `f0c42850d35549ee806b96f027c05634`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:45.174259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:45.257734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1045/2055] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:45.269947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:45.271256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:45.362618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846ead1-4464-4550-9762-ff26b55ed990 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:45.426767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:45.437630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef603ca8-d777-469a-8950-afb129bc156c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:45.438284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef603ca8-d777-469a-8950-afb129bc156c service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.438570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef603ca8-d777-469a-8950-afb129bc156c service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.438846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef603ca8-d777-469a-8950-afb129bc156c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.447880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef603ca8-d777-469a-8950-afb129bc156c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:45.449470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef603ca8-d777-469a-8950-afb129bc156c service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:45.459393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1011/2056] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:45.730982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:45.816084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958f4e-bad7-401b-a2be-411705a378b9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:45.822209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:45.823153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.823438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.823711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] PATH_INFO: `/v3/users/f0c42850d35549ee806b96f027c05634` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:45.824876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c42850d35549ee806b96f027c05634)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:45.827042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:45.930585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c42850d35549ee806b96f027c05634'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:45.947538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c42850d35549ee806b96f027c05634'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:45.948691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c42850d35549ee806b96f027c05634'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:45.958499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:45.969327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c42850d35549ee806b96f027c05634'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:45.979283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c42850d35549ee806b96f027c05634'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:45.986579 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1046/2057] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:45 2022] DELETE /identity/v3/users/f0c42850d35549ee806b96f027c05634 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:45.991843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:45.992767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:45.993268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.015125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:46.016546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.114518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1012/2058] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:46.124905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.126535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.194736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ef936-367e-4203-b9c8-9467b79c7e96 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.199380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.200000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.200285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.200556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.214969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.216713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.230426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1047/2059] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:46.517732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.520460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.533046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51640f5-9b49-432e-a3a7-97a3aefbb658 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.539826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.540479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.540769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.541093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] PATH_INFO: `/v3/projects/68550fa64d3d4ce2b1ad69ec72f3f43c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.542286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68550fa64d3d4ce2b1ad69ec72f3f43c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.544359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.588807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.590479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.600399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68550fa64d3d4ce2b1ad69ec72f3f43c', 'request_id': 'req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.605253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da092c3-d6fe-45e1-a829-3afa1f6939cd service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.608588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68550fa64d3d4ce2b1ad69ec72f3f43c', 'request_id': 'req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.616024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68550fa64d3d4ce2b1ad69ec72f3f43c', 'request_id': 'req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.627519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] The token cache is being invalidate because project 68550fa64d3d4ce2b1ad69ec72f3f43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:46.627839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.628618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-84adb6b1-1792-4f99-a978-c1f4f2cdc2b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.630664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1013/2060] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:46 2022] DELETE /identity/v3/projects/68550fa64d3d4ce2b1ad69ec72f3f43c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:46.636988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1221f-5744-43f5-b843-4ef2a79f4cf7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.637276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1221f-5744-43f5-b843-4ef2a79f4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.637549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1221f-5744-43f5-b843-4ef2a79f4cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.658860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-91b1221f-5744-43f5-b843-4ef2a79f4cf7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:46.660206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-91b1221f-5744-43f5-b843-4ef2a79f4cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.670814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.671447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.671735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.672041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] PATH_INFO: `/v3/users/7f4b4b5ee99d4c1aad21f8f861e04672` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.673178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4b4b5ee99d4c1aad21f8f861e04672)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.675141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.722662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4b4b5ee99d4c1aad21f8f861e04672'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.724687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1014/2061] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:46.729862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4b4b5ee99d4c1aad21f8f861e04672'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.730626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4b4b5ee99d4c1aad21f8f861e04672'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.732014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.732308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.732598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.744004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4b4b5ee99d4c1aad21f8f861e04672'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.752201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2b93c7e7-7267-4c00-913f-f4b61958c8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4b4b5ee99d4c1aad21f8f861e04672'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:46.755897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:46.757117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.758674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1048/2062] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:46 2022] DELETE /identity/v3/users/7f4b4b5ee99d4c1aad21f8f861e04672 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:46.763028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.763320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.763601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.766294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:46.771472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:46.786599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:46.787826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.822913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1015/2063] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:46.827318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.836741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4731d-918c-46f5-a819-899e5dc92bb8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.841684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.842344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.842734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.843042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.843689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:46.843993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.845621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.853324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1049/2064] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:46.862344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1016/2065] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:16:46.863905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.864597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.866049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:46.874154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba774485-f6ee-43b2-bd3e-713ac0295fe8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.878976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.879718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.880005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.880289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.880956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.882914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.911131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1017/2066] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:46 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:46.915240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:46.927075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d1ae4-c1e0-4dd5-96e3-4824d7a1ae4e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.976050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.976575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.977175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.977175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.980549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb81fa-8cea-4188-ad54-8b683a9e18d3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:46.986641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.986847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:46.987463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:46.987752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:46.988031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:46.988188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.989231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:46.991344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:46.999605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1050/2067] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:47.018959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1018/2068] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:46 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:47.023480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.034159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fee95f-892b-48cc-9e59-ae2712ceeda6 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.040887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.041493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.041814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.042090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.042732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.044313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.059017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1051/2069] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:47.063114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.074731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81981fa1-dccf-4dc2-a50c-6d1c230060a7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.079656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eebf50-3042-4e5f-a1ee-b458ad419f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.080332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eebf50-3042-4e5f-a1ee-b458ad419f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.080613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eebf50-3042-4e5f-a1ee-b458ad419f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.080889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eebf50-3042-4e5f-a1ee-b458ad419f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.081548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eebf50-3042-4e5f-a1ee-b458ad419f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.083542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eebf50-3042-4e5f-a1ee-b458ad419f60 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.095732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1019/2070] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:47.100830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.111632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b4c97-8b49-46c0-b8bf-95354533c0c4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.117295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.118151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.118564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.119218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] PATH_INFO: `/v3/projects/fb3703e451e341fbb0d1034d8f37d515/users/a58495618ce54a60b51feff05b4f037f/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.137556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3703e451e341fbb0d1034d8f37d515, user_id=a58495618ce54a60b51feff05b4f037f, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.140334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.155250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1052/2071] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:47 2022] PUT /identity/v3/projects/fb3703e451e341fbb0d1034d8f37d515/users/a58495618ce54a60b51feff05b4f037f/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:47.166975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.167351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.167711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.197259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] MFA Rules not processed for user `a58495618ce54a60b51feff05b4f037f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:47.198517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:47.251493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:47.277846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1020/2072] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:47 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:47.282585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.320940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:47.358010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72435111-364e-4edd-8a90-e82d91a5b9b2 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.362775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.363517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.363833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.364261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.364942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.367267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.388253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.389858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:47.414818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd67189-e74b-4793-9110-f276b469ecf8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.420823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1053/2073] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:47 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:47.422345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.493163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.493643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.493961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.494235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] PATH_INFO: `/v3/projects/12fc6d5230ea41609190932836553a6e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.495428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fc6d5230ea41609190932836553a6e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.506054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.522242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133411c7-ebca-49fc-a30a-e66acbd2b56a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.528446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.529207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.529498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.529876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.530651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.532842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.555344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fc6d5230ea41609190932836553a6e', 'request_id': 'req-0b465e11-6701-48c8-92fd-a290e315939f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.562479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fc6d5230ea41609190932836553a6e', 'request_id': 'req-0b465e11-6701-48c8-92fd-a290e315939f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.566069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1054/2074] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:47 2022] POST /identity/v3/users => generated 307 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:47.570732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.570893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fc6d5230ea41609190932836553a6e', 'request_id': 'req-0b465e11-6701-48c8-92fd-a290e315939f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.580584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085bb34-67b2-4e83-84d7-1f511f942c04 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.581481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] The token cache is being invalidate because project 12fc6d5230ea41609190932836553a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:47.581840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.583081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.584751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1021/2075] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:47 2022] DELETE /identity/v3/projects/12fc6d5230ea41609190932836553a6e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:47.588378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.589834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:47.643832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.645195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.645471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.645840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.646613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.648538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.656976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b465e11-6701-48c8-92fd-a290e315939f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.662624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1055/2076] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:47.662799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.662799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.662982 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.663267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] PATH_INFO: `/v3/users/1e66864a9d7c4f56bb8e544d8eb373e4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.664499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e66864a9d7c4f56bb8e544d8eb373e4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.664602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.666288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:47.666478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.680091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97745a26-d04e-4c9e-b777-19cf4f1078db admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.685544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.686332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.686625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.686905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] PATH_INFO: `/v3/projects/eb0674877b124116acf61d28f9f197f2/users/cb8c93721b6c4a7facb810bc09b62c91/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.689670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:47.709438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0674877b124116acf61d28f9f197f2, user_id=cb8c93721b6c4a7facb810bc09b62c91, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.712730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.720827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e66864a9d7c4f56bb8e544d8eb373e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.727009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1056/2077] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:47 2022] PUT /identity/v3/projects/eb0674877b124116acf61d28f9f197f2/users/cb8c93721b6c4a7facb810bc09b62c91/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:47.728376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e66864a9d7c4f56bb8e544d8eb373e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.729081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e66864a9d7c4f56bb8e544d8eb373e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.730935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.736760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e66864a9d7c4f56bb8e544d8eb373e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.737513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e66864a9d7c4f56bb8e544d8eb373e4'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:47.748227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:47.758725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1022/2078] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:47 2022] DELETE /identity/v3/users/1e66864a9d7c4f56bb8e544d8eb373e4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:47.800756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6dda9-777a-4633-883d-941a1dcf1e98 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.868240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd7621-a2f3-4094-9b91-153336352bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.868866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7621-a2f3-4094-9b91-153336352bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.869144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7621-a2f3-4094-9b91-153336352bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.869418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd7621-a2f3-4094-9b91-153336352bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.870128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7621-a2f3-4094-9b91-153336352bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.871753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdd7621-a2f3-4094-9b91-153336352bd8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.885252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1057/2079] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:47.886681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:47.888290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:47.902281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b3e09-f64b-4395-bb66-c4a3e0d2910a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:47.910552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:47.911340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.911818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.918939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] PATH_INFO: `/v3/projects/eb0674877b124116acf61d28f9f197f2/users/cb8c93721b6c4a7facb810bc09b62c91/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.926581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0674877b124116acf61d28f9f197f2, user_id=cb8c93721b6c4a7facb810bc09b62c91, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:47.929375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:47.940926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1023/2080] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:47 2022] PUT /identity/v3/projects/eb0674877b124116acf61d28f9f197f2/users/cb8c93721b6c4a7facb810bc09b62c91/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:47.951557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:47.951840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:47.952110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:47.988388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] MFA Rules not processed for user `cb8c93721b6c4a7facb810bc09b62c91`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:47.989612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:48.047093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:48.049131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:48.073850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1058/2081] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:48.088916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:48.091430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:48.143467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:48.151164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c09f6-b92c-4e9d-bf46-04df19e5f0e4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:48.156248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:48.157023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:48.157313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:48.157783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] PATH_INFO: `/v3/projects/0e9075552d4f476e8c2ae79e2ae643e2` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:48.158922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9075552d4f476e8c2ae79e2ae643e2)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:48.160305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd11768-cce2-48f3-bff4-688e2788a6b3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:48.161162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:48.164344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:48.165066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:48.165450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:48.165853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:48.175525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:48.177772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:48.188091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1059/2082] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:48 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:48.218213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9075552d4f476e8c2ae79e2ae643e2', 'request_id': 'req-91317ffc-cda7-47d8-b69e-14040cd3a6e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.232159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9075552d4f476e8c2ae79e2ae643e2', 'request_id': 'req-91317ffc-cda7-47d8-b69e-14040cd3a6e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.252647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9075552d4f476e8c2ae79e2ae643e2', 'request_id': 'req-91317ffc-cda7-47d8-b69e-14040cd3a6e5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.273699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] The token cache is being invalidate because project 0e9075552d4f476e8c2ae79e2ae643e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:48.274169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.274971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.277121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1024/2083] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:48 2022] DELETE /identity/v3/projects/0e9075552d4f476e8c2ae79e2ae643e2 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:48.279037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:48.281263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:48.282723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:48.290706 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa41ef-4f76-462f-8126-eca1af7049bc service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:48.298741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:48.357132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:48.357762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:48.358046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:48.359262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:48.360907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:48.373530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91317ffc-cda7-47d8-b69e-14040cd3a6e5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:48.381529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:48.382336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:48.382722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:48.383006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] PATH_INFO: `/v3/users/b76984c0a6314ccf8334fd2fe7a5fc26` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:48.384739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b76984c0a6314ccf8334fd2fe7a5fc26)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:48.387178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:48.432048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:48.434125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:48.443112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b76984c0a6314ccf8334fd2fe7a5fc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.444752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1060/2084] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:48 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:48.451293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b76984c0a6314ccf8334fd2fe7a5fc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.452837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b76984c0a6314ccf8334fd2fe7a5fc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.469366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b76984c0a6314ccf8334fd2fe7a5fc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.470102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8fbb573b-1e03-4f07-be77-fff022647046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b76984c0a6314ccf8334fd2fe7a5fc26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.490574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1025/2085] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:48 2022] DELETE /identity/v3/users/b76984c0a6314ccf8334fd2fe7a5fc26 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:48.585431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:48.586929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:48.602528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22e85f-e493-4854-b94c-f11f02953bf2 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:48.688361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:48.689080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:48.689438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:48.689829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] PATH_INFO: `/v3/users/ddd39a8d2d794919bde46ed11b6c7494` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:48.691310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd39a8d2d794919bde46ed11b6c7494)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:48.695268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:48.771290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:48.790073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd39a8d2d794919bde46ed11b6c7494'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.804046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd39a8d2d794919bde46ed11b6c7494'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.805968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd39a8d2d794919bde46ed11b6c7494'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.863262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd39a8d2d794919bde46ed11b6c7494'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.881921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd39a8d2d794919bde46ed11b6c7494'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:48.889926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1061/2086] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:48 2022] DELETE /identity/v3/users/ddd39a8d2d794919bde46ed11b6c7494 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:48.898020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:48.898383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:48.898740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:48.936198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:48.936198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.033321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1026/2087] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:49.044829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.046593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.071423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.073102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.085781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a308de-58fc-46c0-a138-442ae14bb9b0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.090638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.091327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.091535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.091814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] PATH_INFO: `/v3/projects/d10513e0cd574340819c9c125acd32f6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.093054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d10513e0cd574340819c9c125acd32f6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.095064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.133128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:49.144283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0fd7-1837-4dd8-9593-e72053b835e0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.152870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd10513e0cd574340819c9c125acd32f6', 'request_id': 'req-4263f43d-fbfe-4362-923a-71012d20fb7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.163036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd10513e0cd574340819c9c125acd32f6', 'request_id': 'req-4263f43d-fbfe-4362-923a-71012d20fb7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.170861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd10513e0cd574340819c9c125acd32f6', 'request_id': 'req-4263f43d-fbfe-4362-923a-71012d20fb7b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.183909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] The token cache is being invalidate because project d10513e0cd574340819c9c125acd32f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:49.184198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.184869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-4263f43d-fbfe-4362-923a-71012d20fb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.186545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1027/2088] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:49 2022] DELETE /identity/v3/projects/d10513e0cd574340819c9c125acd32f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:49.193257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96430d68-9ff8-4b5c-a9c5-bef3aaab50dd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.193615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96430d68-9ff8-4b5c-a9c5-bef3aaab50dd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.194376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96430d68-9ff8-4b5c-a9c5-bef3aaab50dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.206034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.206689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.207062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.207339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.209334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.216296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-96430d68-9ff8-4b5c-a9c5-bef3aaab50dd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:49.217486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-96430d68-9ff8-4b5c-a9c5-bef3aaab50dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.297451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.305368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1028/2089] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:49.305454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.306918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.307346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.307838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.309875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1062/2090] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:49.331371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:49.333536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.342687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1029/2091] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:49.348059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.358576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b337d-e34e-4541-ae7f-c38126fb6f9f service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.363656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.364264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.364553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.364822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.365541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:49.365997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.367750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.381730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1063/2092] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:49.386688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.397987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db262287-e0c7-496b-97c5-40def1355f65 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.402833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.403433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.403716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.403997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.404633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.406593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.436779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1030/2093] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:49.441174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.452407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f8d5f-7bee-482b-bdeb-ed9f11e357f5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.460531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:49.526695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.527615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.527899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.528168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.528812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.530767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.557437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1064/2094] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:49.561544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.573497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e48f6a-2347-45bd-8fdd-3c207c70fffe admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.579515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.580090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.580417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.580689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.581344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.584142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.595460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1031/2095] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:49.599914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.612290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4266-4d93-4b2e-9bb4-131f25ab0cb6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.618270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.618892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.619205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.619461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.622596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.622596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.624657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.626529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.645634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1065/2096] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:49.649655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48b8cf-0445-4aca-a2ce-fcff02d0a13e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.650929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.665268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.665964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.666221 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.666493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] PATH_INFO: `/v3/projects/269bc19a24f24c83b001ca6a04dfd2ea` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.667790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] RBAC: Authorizing `identity:delete_project(project_id=269bc19a24f24c83b001ca6a04dfd2ea)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.669603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199c533-727f-43c7-b3be-5a6dba622c5b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.669835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.676939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41df9d-ebf1-43f7-a829-4041eae3d9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.678483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41df9d-ebf1-43f7-a829-4041eae3d9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.678726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41df9d-ebf1-43f7-a829-4041eae3d9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.679049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41df9d-ebf1-43f7-a829-4041eae3d9fb admin admin] PATH_INFO: `/v3/projects/05228a85cf6c44e48ef18076a5f874c3/users/6313147d2c774fc79f5ef804b8d98ee3/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.701912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41df9d-ebf1-43f7-a829-4041eae3d9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=05228a85cf6c44e48ef18076a5f874c3, user_id=6313147d2c774fc79f5ef804b8d98ee3, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.701912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41df9d-ebf1-43f7-a829-4041eae3d9fb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.721746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1066/2097] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:49 2022] PUT /identity/v3/projects/05228a85cf6c44e48ef18076a5f874c3/users/6313147d2c774fc79f5ef804b8d98ee3/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:49.732484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.732780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.733052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.735185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269bc19a24f24c83b001ca6a04dfd2ea', 'request_id': 'req-fd8f9288-cfda-4d17-81b2-ede24d91727c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.743134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269bc19a24f24c83b001ca6a04dfd2ea', 'request_id': 'req-fd8f9288-cfda-4d17-81b2-ede24d91727c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.750236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269bc19a24f24c83b001ca6a04dfd2ea', 'request_id': 'req-fd8f9288-cfda-4d17-81b2-ede24d91727c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.760820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:49.765044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] MFA Rules not processed for user `6313147d2c774fc79f5ef804b8d98ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:49.766495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.766631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] The token cache is being invalidate because project 269bc19a24f24c83b001ca6a04dfd2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:49.766954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.767751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-fd8f9288-cfda-4d17-81b2-ede24d91727c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:49.770294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1032/2098] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:49 2022] DELETE /identity/v3/projects/269bc19a24f24c83b001ca6a04dfd2ea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:49.775761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5479-c681-48b6-860f-30d56934dd6a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.776153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5479-c681-48b6-860f-30d56934dd6a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.776594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae5479-c681-48b6-860f-30d56934dd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.802272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c9ae5479-c681-48b6-860f-30d56934dd6a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:49.803595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c9ae5479-c681-48b6-860f-30d56934dd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.844808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1067/2099] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:49.849017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.851281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.875475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1033/2100] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:49.884176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.884468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.884749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.906906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:49.908230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:49.917769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1034/2101] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:49.922304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.941053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110e610-a475-4df4-b4b3-f4b69c397b2e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.944923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:49.947040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.947712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.947994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.948276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.948959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:49.949266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.951149 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.954565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5783862d-39ee-49f7-a67a-b9afb86703c5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:49.962360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:49.963283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:49.964250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:49.964611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:49.965414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:49.969052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:49.980207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1035/2102] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:49.984713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:49.999378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7b50f-f5b7-49f8-b1ef-b46db8a8b1eb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.004585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.007899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1068/2103] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/projects => generated 387 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:50.008045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.008045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.008045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.008045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.008424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.008892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.044165 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1036/2104] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:49 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:50.045922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.101328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f9b57-ef91-422a-a8e1-fdd55a152d6e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.116658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fa78a-519f-4bfc-b331-4f2e85ca426c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.121622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.122259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.122538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.122807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.123445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.125378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.152709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1037/2105] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:50 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:50.157602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.173831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5597dc2-c0bf-4a14-84c7-e5f936759b96 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.179075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.179841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.180103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.180371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.181054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.182446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.183583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.183880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.184286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.184825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.185738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.188546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.201637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1038/2106] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:50.206326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.213758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1069/2107] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:50 2022] POST /identity/v3/users => generated 300 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:50.215436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.219630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3ab2a-df73-40a4-a85a-6f868d399f6a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.228979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.229831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.230558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a94fe-aa05-4048-a65a-d415228579dd admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.230859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.231243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.232413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.235579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.236816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.237498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.237863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.238692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.239587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.241462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.257549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1039/2108] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:50.269870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1070/2109] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:50.270136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.274892 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece11b2-b5ee-4a33-b624-89b6397444b1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.280954 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.291212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a55ff-7418-4516-b59d-e2e9cd04d4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.292084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a55ff-7418-4516-b59d-e2e9cd04d4b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.292402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a55ff-7418-4516-b59d-e2e9cd04d4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.292728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a55ff-7418-4516-b59d-e2e9cd04d4b6 admin admin] PATH_INFO: `/v3/projects/e2b81057b3f34d4eab87a41c5180a74d/users/af512a6a991943a3b310cd0dacdd1843/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.295502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4efd1c-18e4-4523-bdb9-cee606d822d7 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.312250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a55ff-7418-4516-b59d-e2e9cd04d4b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2b81057b3f34d4eab87a41c5180a74d, user_id=af512a6a991943a3b310cd0dacdd1843, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.314225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.314914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.315201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.315483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] PATH_INFO: `/v3/projects/ba0824f99b004f249330f2852093cfde/users/1e8781c04e8c47a683be4c35a87c295d/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.316758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a55ff-7418-4516-b59d-e2e9cd04d4b6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.346607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1040/2110] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:50 2022] PUT /identity/v3/projects/e2b81057b3f34d4eab87a41c5180a74d/users/af512a6a991943a3b310cd0dacdd1843/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:50.355561 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.355908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.356223 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.360809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0824f99b004f249330f2852093cfde, user_id=1e8781c04e8c47a683be4c35a87c295d, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.364505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.365012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:50.384762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1071/2111] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:50 2022] PUT /identity/v3/projects/ba0824f99b004f249330f2852093cfde/users/1e8781c04e8c47a683be4c35a87c295d/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:50.388823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.397228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] MFA Rules not processed for user `af512a6a991943a3b310cd0dacdd1843`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:50.398937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:50.450120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:50.470881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78df698c-ccd0-4369-81d5-2dce359366af admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.476211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.476816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.477092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.477363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.478036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.479613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.479953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1041/2112] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:50.491448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1072/2113] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:50.491834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.493671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:50.495542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.505509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aebf8-4038-45f0-945e-348ea8736086 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.510682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39a8c4-08ca-400b-b452-81fa6e644897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.511362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a8c4-08ca-400b-b452-81fa6e644897 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.511649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a8c4-08ca-400b-b452-81fa6e644897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.511927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39a8c4-08ca-400b-b452-81fa6e644897 admin admin] PATH_INFO: `/v3/projects/ba0824f99b004f249330f2852093cfde/users/1e8781c04e8c47a683be4c35a87c295d/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.513919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a8c4-08ca-400b-b452-81fa6e644897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba0824f99b004f249330f2852093cfde, user_id=1e8781c04e8c47a683be4c35a87c295d, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.516583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f39a8c4-08ca-400b-b452-81fa6e644897 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.527968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1073/2114] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:50 2022] PUT /identity/v3/projects/ba0824f99b004f249330f2852093cfde/users/1e8781c04e8c47a683be4c35a87c295d/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:50.538963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.539261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.539549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.553557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489971cb-bab9-4343-ab2c-ad84b3308613 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.568704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] MFA Rules not processed for user `1e8781c04e8c47a683be4c35a87c295d`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:50.569963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:50.612999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.613649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.613963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.614279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.650771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1074/2115] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:50.663825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:50.665893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:50.677131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.678745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.679480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531d87a-c232-4a04-86b1-432a6891b4d4 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:50.683610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd7f3-d1a1-4bd8-aad3-cd38beeec838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:50.684211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd7f3-d1a1-4bd8-aad3-cd38beeec838 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:50.684494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd7f3-d1a1-4bd8-aad3-cd38beeec838 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:50.684770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd7f3-d1a1-4bd8-aad3-cd38beeec838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:50.688237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1042/2116] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:50.699164 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd7f3-d1a1-4bd8-aad3-cd38beeec838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:50.700737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd7f3-d1a1-4bd8-aad3-cd38beeec838 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:50.719872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1075/2117] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:50 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:51.354717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:51.359096 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:51.428900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae26b88-aa13-4980-a806-3c799c7a09e3 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:51.433986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:51.434535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:51.434816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:51.435087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] PATH_INFO: `/v3/users/6313147d2c774fc79f5ef804b8d98ee3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:51.436372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6313147d2c774fc79f5ef804b8d98ee3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:51.438498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:51.492742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6313147d2c774fc79f5ef804b8d98ee3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:51.502880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6313147d2c774fc79f5ef804b8d98ee3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:51.503594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6313147d2c774fc79f5ef804b8d98ee3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:51.514206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6313147d2c774fc79f5ef804b8d98ee3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:51.515064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6313147d2c774fc79f5ef804b8d98ee3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:51.545682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1043/2118] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:51 2022] DELETE /identity/v3/users/6313147d2c774fc79f5ef804b8d98ee3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:51.550364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:51.550821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:51.551620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:51.573297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:51.574628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:51.644366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1076/2119] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:51.655846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:51.658693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:51.726849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f458a-5cc2-4e40-9fe8-65c8f031aafb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:51.730865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa685190-8f7d-46c5-a148-152b30259b12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:51.731474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa685190-8f7d-46c5-a148-152b30259b12 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:51.731839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa685190-8f7d-46c5-a148-152b30259b12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:51.732182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa685190-8f7d-46c5-a148-152b30259b12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:51.745938 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa685190-8f7d-46c5-a148-152b30259b12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:51.747463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa685190-8f7d-46c5-a148-152b30259b12 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:51.759925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1044/2120] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:52.104003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:52.105295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:52.108511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:52.108894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:52.109246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:52.124263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1b59f-60ad-4bd0-8119-b02717dd597c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:52.130776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:52.131880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:52.132372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:52.132782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] PATH_INFO: `/v3/projects/05228a85cf6c44e48ef18076a5f874c3` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:52.134564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05228a85cf6c44e48ef18076a5f874c3)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:52.136490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:52.138968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] MFA Rules not processed for user `af512a6a991943a3b310cd0dacdd1843`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:52.141297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:52.164173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:52.178519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:52.192543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05228a85cf6c44e48ef18076a5f874c3', 'request_id': 'req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.200395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05228a85cf6c44e48ef18076a5f874c3', 'request_id': 'req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.206811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1045/2121] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:52.207512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05228a85cf6c44e48ef18076a5f874c3', 'request_id': 'req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.219211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] The token cache is being invalidate because project 05228a85cf6c44e48ef18076a5f874c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:52.219511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.220230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.221784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1077/2122] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:52 2022] DELETE /identity/v3/projects/05228a85cf6c44e48ef18076a5f874c3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:52.226358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:52.237128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d460866-d963-4e2f-bad3-7dffc3f66ac0 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:52.296691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:52.297319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:52.297598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:52.297899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] PATH_INFO: `/v3/users/1e8781c04e8c47a683be4c35a87c295d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:52.299054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8781c04e8c47a683be4c35a87c295d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:52.301125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:52.355847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8781c04e8c47a683be4c35a87c295d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.363307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8781c04e8c47a683be4c35a87c295d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.364462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8781c04e8c47a683be4c35a87c295d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.371318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8781c04e8c47a683be4c35a87c295d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.371981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8781c04e8c47a683be4c35a87c295d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.391047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1046/2123] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:52 2022] DELETE /identity/v3/users/1e8781c04e8c47a683be4c35a87c295d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:52.685816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:52.687565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:52.751294 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9e7a7-489c-42f9-a9f1-2ce1b1de8096 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:52.855698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:52.857329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:52.857616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:52.857937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] PATH_INFO: `/v3/projects/ba0824f99b004f249330f2852093cfde` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:52.859103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba0824f99b004f249330f2852093cfde)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:52.861207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:52.944861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba0824f99b004f249330f2852093cfde', 'request_id': 'req-20827945-f80e-4ac7-bd0a-069629e045cb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.953144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba0824f99b004f249330f2852093cfde', 'request_id': 'req-20827945-f80e-4ac7-bd0a-069629e045cb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.963389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba0824f99b004f249330f2852093cfde', 'request_id': 'req-20827945-f80e-4ac7-bd0a-069629e045cb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.978974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:52.981435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:52.987025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] The token cache is being invalidate because project ba0824f99b004f249330f2852093cfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:52.987755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.989924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-20827945-f80e-4ac7-bd0a-069629e045cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:52.993418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1078/2124] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:52 2022] DELETE /identity/v3/projects/ba0824f99b004f249330f2852093cfde => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:52.997029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad486375-c38f-45c9-a6e6-afd2a9e2bf0c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:52.999075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a923-5fad-43a5-84d7-a182be769150 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.000132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a923-5fad-43a5-84d7-a182be769150 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.000350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed6a923-5fad-43a5-84d7-a182be769150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.030221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-3ed6a923-5fad-43a5-84d7-a182be769150 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:53.031652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3ed6a923-5fad-43a5-84d7-a182be769150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:53.094616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:53.094976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:53.122910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.123503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.123789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.124114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] PATH_INFO: `/v3/users/a58495618ce54a60b51feff05b4f037f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.125786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a58495618ce54a60b51feff05b4f037f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.127704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.133060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1079/2125] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:53.142190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.143243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.143243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.179565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:53.180873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:53.192867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1080/2126] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:53.196101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.209890 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a58495618ce54a60b51feff05b4f037f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:53.219135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75623f74-dba2-4e94-b306-49d7922e750c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.219971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a58495618ce54a60b51feff05b4f037f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:53.221379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a58495618ce54a60b51feff05b4f037f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:53.225611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.226466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.226785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.227173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.228067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:53.228641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.230867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.234746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a58495618ce54a60b51feff05b4f037f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:53.235693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a95e1511-3022-404c-868c-9b7a20b11cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a58495618ce54a60b51feff05b4f037f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:53.246756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1081/2127] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:53.251099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.253761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:53.274559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcd62ef-eaa2-4402-81a9-0e12ce0fd817 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.278035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1047/2128] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:52 2022] DELETE /identity/v3/users/a58495618ce54a60b51feff05b4f037f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:53.279759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.280088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.280416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.304829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:53.306193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:53.352479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.353415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.353758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.354024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.354783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.357029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.391625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1048/2129] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:53.404833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.406966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:53.410984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1082/2130] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:53 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:53.415209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.476055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90140a6-9cd9-408a-a660-3b8553aa1eed None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.484263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c6bfba-6e03-48ab-ba09-8471f8febe75 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.489125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.489827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.490116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.490395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.491152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.494228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.499534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:53.524299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1083/2131] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:53 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:53.527279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.546222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6069c-1202-4fef-99db-e67fb9d4d146 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.551412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.552024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.552310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.552585 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.553300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.554994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.556555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.558010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.558299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.558718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.569818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1084/2132] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:53.571607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.573280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.574769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.581777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511276f-82cd-492a-ac2d-a363ea480b86 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.586790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1049/2133] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:53.587652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12fbd85-a85f-4371-a293-80ad953f04ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.588264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fbd85-a85f-4371-a293-80ad953f04ac admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.588549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fbd85-a85f-4371-a293-80ad953f04ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.588822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12fbd85-a85f-4371-a293-80ad953f04ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.589469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fbd85-a85f-4371-a293-80ad953f04ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.591103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12fbd85-a85f-4371-a293-80ad953f04ac admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.609521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1085/2134] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:53.614268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.625000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7029dc-12ac-4a1b-9a8e-038be4193c46 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:53.630239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:53.631013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.631296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.631574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] PATH_INFO: `/v3/projects/2e7916ab0bbc4e93944867836b376bbe/users/feeff2a3decb4375a8eda571c6e84c8a/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.648133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e7916ab0bbc4e93944867836b376bbe, user_id=feeff2a3decb4375a8eda571c6e84c8a, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:53.651028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:53.667175 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1050/2135] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:53 2022] PUT /identity/v3/projects/2e7916ab0bbc4e93944867836b376bbe/users/feeff2a3decb4375a8eda571c6e84c8a/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:53.748120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:53.748776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:53.748776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:53.813084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] MFA Rules not processed for user `feeff2a3decb4375a8eda571c6e84c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:53.815505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:53.830776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:53.898139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1086/2136] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:53.902503 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.952135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:53.953584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:54.000602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9d0b5-5ec8-4998-8ec0-33e3120ba517 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.005556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.006226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.006507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.006853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.007481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.009408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.029871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14ed84-5727-45db-aadd-a4d8212c8ec3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.034534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.035996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.036280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.036551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] PATH_INFO: `/v3/projects/fb3703e451e341fbb0d1034d8f37d515` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.037728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3703e451e341fbb0d1034d8f37d515)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.040916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1051/2137] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:53 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:54.041058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.042316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.089350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3703e451e341fbb0d1034d8f37d515', 'request_id': 'req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.097163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3703e451e341fbb0d1034d8f37d515', 'request_id': 'req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.106492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d310af4-9506-4cdc-9b9d-01b153b3b76c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.107532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3703e451e341fbb0d1034d8f37d515', 'request_id': 'req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.124071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] The token cache is being invalidate because project fb3703e451e341fbb0d1034d8f37d515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:54.124368 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.125034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.126873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1087/2138] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:53 2022] DELETE /identity/v3/projects/fb3703e451e341fbb0d1034d8f37d515 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:54.130970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.132320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:54.146077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:54.174483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.175171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.175521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.176678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.177580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.179996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.203747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:54.208037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1052/2139] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:54 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:54.212154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.213962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:54.227284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cec9d49-255b-4b97-a00f-259a8bddde38 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.234124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.234376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dddfeb-5d6c-4e9f-ab61-7395360ddac9 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.234926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.235238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.235664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.236163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.237782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.239968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.241074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.241434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.241731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] PATH_INFO: `/v3/users/cb8c93721b6c4a7facb810bc09b62c91` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.243196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8c93721b6c4a7facb810bc09b62c91)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.246281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.253013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1053/2140] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:54.253941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.267213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4558-6cc5-422d-943a-6af510cc1e81 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.272595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.273723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.273933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.274208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.274858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.276468 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.289589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1054/2141] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:54.294377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.306589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f24da-a574-4b27-9c13-f806c3d38f9b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.312043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe008b32-78cf-4f34-a428-76bcb799bb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.312760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008b32-78cf-4f34-a428-76bcb799bb06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.313042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008b32-78cf-4f34-a428-76bcb799bb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.313373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe008b32-78cf-4f34-a428-76bcb799bb06 admin admin] PATH_INFO: `/v3/projects/956d7e727788490d85d75d99ba8bbf43/users/0958264d6fc44b96aeb7d15da91820c9/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.323911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8c93721b6c4a7facb810bc09b62c91'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.334146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8c93721b6c4a7facb810bc09b62c91'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.335013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8c93721b6c4a7facb810bc09b62c91'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.343713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008b32-78cf-4f34-a428-76bcb799bb06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=956d7e727788490d85d75d99ba8bbf43, user_id=0958264d6fc44b96aeb7d15da91820c9, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.346530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe008b32-78cf-4f34-a428-76bcb799bb06 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.376588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1055/2142] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:54 2022] PUT /identity/v3/projects/956d7e727788490d85d75d99ba8bbf43/users/0958264d6fc44b96aeb7d15da91820c9/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:54.377795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8c93721b6c4a7facb810bc09b62c91'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.387394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.387946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8c93721b6c4a7facb810bc09b62c91'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:54.388724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.389256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.397002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1088/2143] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:16:54 2022] DELETE /identity/v3/users/cb8c93721b6c4a7facb810bc09b62c91 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:54.486541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] MFA Rules not processed for user `0958264d6fc44b96aeb7d15da91820c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:54.490681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:54.590713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1056/2144] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:54.595100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.597503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:54.671935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e862b-e481-4572-8032-cee4951ce8d0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.677653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.678293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.678573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.678845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.679542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.681403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.710178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1089/2145] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:54 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:54.714242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.726217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2664b45-0c61-4d77-bde9-df14f045f7bd None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.801533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.802475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.802817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.803174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.803883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.805866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.823296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:54.833322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1057/2146] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:54 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:54.834637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.845117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273ac7b-6117-4927-84d5-456431a33c6e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.850982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.851812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.852255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.852528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.853192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.854898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.867131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1090/2147] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:54.871256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.883419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c547f-a189-42c4-830c-e8e29244c75e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.889816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:54.890487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:54.890837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:54.891043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] PATH_INFO: `/v3/projects/2b578191690948b9b3e20740d5973861/users/42924863b45841069c0aeae46b7e1591/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:54.899445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.901504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:54.912239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b578191690948b9b3e20740d5973861, user_id=42924863b45841069c0aeae46b7e1591, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:54.918531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:54.936484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ce0002-c0d6-49ab-9606-2581e381ec35 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:54.944464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1058/2148] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:54 2022] PUT /identity/v3/projects/2b578191690948b9b3e20740d5973861/users/42924863b45841069c0aeae46b7e1591/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:54.948419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:54.999520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:55.029827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a2df7-2851-4a3b-ab5b-3813ac3f5e40 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.034628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.035947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.036224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.036489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] PATH_INFO: `/v3/projects/eb0674877b124116acf61d28f9f197f2` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.038019 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0674877b124116acf61d28f9f197f2)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.039687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.047990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.049214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.049568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.049976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.050822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.052717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.067485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1059/2149] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:55.072482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.084752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ef68d-e4e8-46e0-b1f8-b3c07d6630a9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.096949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0674877b124116acf61d28f9f197f2', 'request_id': 'req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:55.108895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0674877b124116acf61d28f9f197f2', 'request_id': 'req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:55.128466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0674877b124116acf61d28f9f197f2', 'request_id': 'req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:55.139628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] The token cache is being invalidate because project eb0674877b124116acf61d28f9f197f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:16:55.140011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:55.140785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-48195d8b-f7c5-443f-8b33-e3ef5e69bf8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:16:55.142729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1091/2150] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:16:54 2022] DELETE /identity/v3/projects/eb0674877b124116acf61d28f9f197f2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:55.147657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81d17-1e09-4333-8347-8ad14cd11957 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.148320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81d17-1e09-4333-8347-8ad14cd11957 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.148587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81d17-1e09-4333-8347-8ad14cd11957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.171538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ffc81d17-1e09-4333-8347-8ad14cd11957 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:55.172867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ffc81d17-1e09-4333-8347-8ad14cd11957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:55.174968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ad1e7-83ea-4b4c-b57a-baeb3ed7960e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.175772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad1e7-83ea-4b4c-b57a-baeb3ed7960e admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.176702 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad1e7-83ea-4b4c-b57a-baeb3ed7960e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.176971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ad1e7-83ea-4b4c-b57a-baeb3ed7960e admin admin] PATH_INFO: `/v3/projects/2b578191690948b9b3e20740d5973861/users/42924863b45841069c0aeae46b7e1591/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.179015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad1e7-83ea-4b4c-b57a-baeb3ed7960e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b578191690948b9b3e20740d5973861, user_id=42924863b45841069c0aeae46b7e1591, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.181797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6ad1e7-83ea-4b4c-b57a-baeb3ed7960e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.182470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1092/2151] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:55.190038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.190325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.190605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.195308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1060/2152] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:55 2022] PUT /identity/v3/projects/2b578191690948b9b3e20740d5973861/users/42924863b45841069c0aeae46b7e1591/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:55.206995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.207418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.209687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.226479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:55.227812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:55.243234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] MFA Rules not processed for user `42924863b45841069c0aeae46b7e1591`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:55.244613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:55.308533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1093/2153] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:55.312428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.327823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:55.333789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161cb6d3-834f-4011-bc00-19b3cf64c397 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.341569 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.342556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.342989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.343383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.344438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:16:55.344807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.347754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.351671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1061/2154] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:16:55.363365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1094/2155] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:16:55.367362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.370257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.372017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:55.379401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59106cbf-b403-4844-90c3-0ea62a00abb7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.384264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.384876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.385206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.385484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.386168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.388255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.422555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1062/2156] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:55.427885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.437553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:55.443169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33335b-3429-4ded-b380-4ed0e2bb17a3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.513059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0b3f-bc71-4ac9-8e89-1735946184e3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.513666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.514406 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.514705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.515056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.516898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:55.518346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.519030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.519439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.520333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.521606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.524071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.553747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1063/2157] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:55.557423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.576297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5007c6e3-9c0c-4d78-a02f-4b90dbec9bdb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.583158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.584197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.584656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.585071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.585887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.587694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.601744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1064/2158] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:55.605594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.608646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.610532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.621508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c696db68-ff17-4a83-a379-c61707235215 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.623566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1095/2159] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:16:55.627202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ed22a-fe2a-43b4-8758-1d0be419edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.627825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed22a-fe2a-43b4-8758-1d0be419edba admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.628100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed22a-fe2a-43b4-8758-1d0be419edba admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.628487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ed22a-fe2a-43b4-8758-1d0be419edba admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.629917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ed22a-fe2a-43b4-8758-1d0be419edba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.631836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ed22a-fe2a-43b4-8758-1d0be419edba admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.644195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1065/2160] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:55.648884 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:55.665623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd5315-c1ac-4001-92fc-521b1be016ec service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:55.670485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:55.671236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.671503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.671684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] PATH_INFO: `/v3/projects/a41389c784704914b55cd7d8a72cd0ae/users/763dd4193f98435c8ce19c999764e794/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.689341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41389c784704914b55cd7d8a72cd0ae, user_id=763dd4193f98435c8ce19c999764e794, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:55.693447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:55.714342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1096/2161] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:55 2022] PUT /identity/v3/projects/a41389c784704914b55cd7d8a72cd0ae/users/763dd4193f98435c8ce19c999764e794/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:55.727703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:55.728570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:55.729370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:55.776299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] MFA Rules not processed for user `763dd4193f98435c8ce19c999764e794`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:55.778776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:55.907859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1066/2162] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:55.917517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.055692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7c05-0982-46c3-9bdc-96f172d7ce64 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.064916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.065557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.066208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.066803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.067837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.079824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.148099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1097/2163] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:55 2022] POST /identity/v3/projects => generated 383 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:56.154807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.178459 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ebf03-78b7-4c10-b2b1-ade9adde313b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.202570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:56.243964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.244582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.244861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.245131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.245950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.247885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.275477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1067/2164] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:56 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:56.280439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.298039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37981142-34c2-407e-888a-362eb3195417 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.305742 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.306663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.307067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.307806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.308693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.310430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.329935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1098/2165] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:56.330066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.339566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5fe2d-9872-4f38-b198-280aa3a4a8ef admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.344815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536baa4-7440-462c-b4ec-75677be9bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.345428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536baa4-7440-462c-b4ec-75677be9bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.345740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536baa4-7440-462c-b4ec-75677be9bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.346041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536baa4-7440-462c-b4ec-75677be9bbcb admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.346888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536baa4-7440-462c-b4ec-75677be9bbcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.349147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536baa4-7440-462c-b4ec-75677be9bbcb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.361794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1068/2166] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:56.365346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.375768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc2ed2-2d3d-4683-848b-4ee21a40021d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.382258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.382821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.383268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.383525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] PATH_INFO: `/v3/projects/3376459e16094b269f5a42facb11c633/users/6a55bc0dc967448bbb86e48d2fe52633/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.388526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:56.403212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3376459e16094b269f5a42facb11c633, user_id=6a55bc0dc967448bbb86e48d2fe52633, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.405997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.421771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1099/2167] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:56 2022] PUT /identity/v3/projects/3376459e16094b269f5a42facb11c633/users/6a55bc0dc967448bbb86e48d2fe52633/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:56.433434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.433932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.434476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.465911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] MFA Rules not processed for user `6a55bc0dc967448bbb86e48d2fe52633`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:56.467289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:56.536088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1069/2168] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:56.540927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.608556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec5aa4-1b1f-436f-92a4-d9de9a0f038f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.614319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.614910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.615195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.615466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.616113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.618074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.648886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1100/2169] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:16:56 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:16:56.652999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.664419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2fa80-c650-435a-8e70-60b03d1596cb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.725592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.726234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.726513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.726783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.727414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.729346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.758393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1070/2170] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:16:56 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:16:56.759809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.770302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986169c6-d7f4-4f07-adea-f6d0544ecbb1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.775936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.776571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.776838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.777112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.777797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.779397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.791135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1101/2171] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:16:56.796009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.807217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23721e16-19f3-46cf-96f3-199ac216fcf2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.811849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.812489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.812764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.813033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] PATH_INFO: `/v3/projects/d77bf644db994d4daf294737b8f39c3a/users/46c11863d0b445efa3032f83b99bad13/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.830515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77bf644db994d4daf294737b8f39c3a, user_id=46c11863d0b445efa3032f83b99bad13, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.834032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.842288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:56.849487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1071/2172] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:56 2022] PUT /identity/v3/projects/d77bf644db994d4daf294737b8f39c3a/users/46c11863d0b445efa3032f83b99bad13/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:16:56.854266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.866854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55a69b-d3e6-43b1-ae99-b2b73bf5f3f7 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.945592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa293e91-aca6-4987-93b3-6621f76cd9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.946462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa293e91-aca6-4987-93b3-6621f76cd9ea admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.946675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa293e91-aca6-4987-93b3-6621f76cd9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.946999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa293e91-aca6-4987-93b3-6621f76cd9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.947717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa293e91-aca6-4987-93b3-6621f76cd9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.949384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa293e91-aca6-4987-93b3-6621f76cd9ea admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.961102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1102/2173] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:16:56.965328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:56.976618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b672e8e-4b47-4aab-b072-9e8a28ccd247 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:56.981241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:56.981928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:56.982214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:56.982487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] PATH_INFO: `/v3/projects/d77bf644db994d4daf294737b8f39c3a/users/46c11863d0b445efa3032f83b99bad13/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:56.984599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d77bf644db994d4daf294737b8f39c3a, user_id=46c11863d0b445efa3032f83b99bad13, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:56.987363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:56.998079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1072/2174] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:16:56 2022] PUT /identity/v3/projects/d77bf644db994d4daf294737b8f39c3a/users/46c11863d0b445efa3032f83b99bad13/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:16:57.008835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:57.009196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:57.009478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:57.040409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] MFA Rules not processed for user `46c11863d0b445efa3032f83b99bad13`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:16:57.041649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:57.092257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:16:57.124999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1103/2175] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:16:57 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:16:57.138014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:57.205038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c15c35-6687-40ea-b899-707cfb208d61 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:57.209753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:57.210591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:57.211069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:57.211451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:57.302668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:57.304578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:57.314776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1073/2176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:57.600981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:57.602872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:57.615299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd022c07-907a-4a3b-87c7-961ce85c42d3 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:57.619251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:57.619877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:57.620124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:57.620372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:57.622273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:16:57.713604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:57.715750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:57.726334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1104/2177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:58.303900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:58.312496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cd53d1-c653-4b69-8c7f-0fc34200d063 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:58.316103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:58.317208 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:58.317491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:58.317791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:58.378103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:58.380295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:58.390028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1074/2178] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:59.012277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:59.021230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92dbf8-35ca-47fe-b68e-e6bb3a4976fe service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:59.025860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:59.026672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:59.026987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:59.028170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:59.093137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:59.094607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:59.105077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1105/2179] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:16:59.638658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:16:59.649191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a86958-b5a6-42e5-ab04-f451bea9ef07 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:16:59.653150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818a2f-3a9d-45f3-a695-5d28638cd1b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:16:59.653756 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818a2f-3a9d-45f3-a695-5d28638cd1b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:16:59.654041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818a2f-3a9d-45f3-a695-5d28638cd1b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:16:59.654314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818a2f-3a9d-45f3-a695-5d28638cd1b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:16:59.663635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818a2f-3a9d-45f3-a695-5d28638cd1b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:16:59.665083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818a2f-3a9d-45f3-a695-5d28638cd1b4 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:16:59.674955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1075/2180] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:16:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:02.302887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:02.304387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:02.373338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c4f3-5291-49c2-8b49-a757119f1cf0 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:02.378172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:02.378844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:02.379093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:02.379391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] PATH_INFO: `/v3/users/feeff2a3decb4375a8eda571c6e84c8a` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:02.380642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] RBAC: Authorizing `identity:delete_user(user_id=feeff2a3decb4375a8eda571c6e84c8a)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:02.382598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:02.406964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:02.434544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'feeff2a3decb4375a8eda571c6e84c8a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:02.441387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'feeff2a3decb4375a8eda571c6e84c8a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:02.442127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'feeff2a3decb4375a8eda571c6e84c8a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:02.453803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'feeff2a3decb4375a8eda571c6e84c8a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:02.462716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'feeff2a3decb4375a8eda571c6e84c8a'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:02.469117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1106/2181] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:02 2022] DELETE /identity/v3/users/feeff2a3decb4375a8eda571c6e84c8a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:02.474967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:02.475445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:02.475630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:02.496126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:02.497382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:02.510559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:02.561200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1076/2182] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:02.572419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:02.574080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:02.680864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913f740-c576-4f32-a106-444e82ace272 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:02.690327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:02.691148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:02.692365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:02.692752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:02.705169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:02.707905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:02.727572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1107/2183] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:03.077811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:03.079465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:03.092539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c0ef0c-225c-4757-80e9-49c3e098bb8f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:03.097238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:03.098531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:03.098879 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:03.099160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] PATH_INFO: `/v3/projects/2e7916ab0bbc4e93944867836b376bbe` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:03.100317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e7916ab0bbc4e93944867836b376bbe)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:03.102475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:03.167854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e7916ab0bbc4e93944867836b376bbe', 'request_id': 'req-1952bb7f-e00f-48d2-bd49-0e077aba6b51'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.178703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e7916ab0bbc4e93944867836b376bbe', 'request_id': 'req-1952bb7f-e00f-48d2-bd49-0e077aba6b51'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.188869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e7916ab0bbc4e93944867836b376bbe', 'request_id': 'req-1952bb7f-e00f-48d2-bd49-0e077aba6b51'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.206746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] The token cache is being invalidate because project 2e7916ab0bbc4e93944867836b376bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:03.207737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.210313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.214653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1077/2184] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:03 2022] DELETE /identity/v3/projects/2e7916ab0bbc4e93944867836b376bbe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:03.218839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:03.231549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9478-8547-422d-95c2-c75b37eeed48 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:03.314722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:03.315458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:03.315656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:03.315927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] PATH_INFO: `/v3/users/0958264d6fc44b96aeb7d15da91820c9` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:03.317879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0958264d6fc44b96aeb7d15da91820c9)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:03.319870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:03.386347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:03.397464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0958264d6fc44b96aeb7d15da91820c9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.411535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0958264d6fc44b96aeb7d15da91820c9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.415784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0958264d6fc44b96aeb7d15da91820c9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.432756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0958264d6fc44b96aeb7d15da91820c9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.442321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0958264d6fc44b96aeb7d15da91820c9'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.448599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1108/2185] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:03 2022] DELETE /identity/v3/users/0958264d6fc44b96aeb7d15da91820c9 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:03.635285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:03.637013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:03.650592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1952bb7f-e00f-48d2-bd49-0e077aba6b51 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:03.709631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:03.710251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:03.710535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:03.710811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] PATH_INFO: `/v3/users/763dd4193f98435c8ce19c999764e794` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:03.711946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763dd4193f98435c8ce19c999764e794)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:03.713906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:03.741142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:03.742648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:03.759670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37b92b-52dc-420c-a3da-2419556a5255 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:03.765741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:03.766411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:03.766699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:03.766978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] PATH_INFO: `/v3/projects/956d7e727788490d85d75d99ba8bbf43` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:03.768137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=956d7e727788490d85d75d99ba8bbf43)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:03.770625 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:03.775450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:03.777611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763dd4193f98435c8ce19c999764e794'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.788735 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763dd4193f98435c8ce19c999764e794'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.789471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763dd4193f98435c8ce19c999764e794'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.797452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763dd4193f98435c8ce19c999764e794'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.798189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5f7fbbea-6e02-4d8e-b445-0c9eff6bfe87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763dd4193f98435c8ce19c999764e794'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.817840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1078/2186] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:03 2022] DELETE /identity/v3/users/763dd4193f98435c8ce19c999764e794 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:03.822465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:03.822753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:03.823037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:03.824476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '956d7e727788490d85d75d99ba8bbf43', 'request_id': 'req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.832598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '956d7e727788490d85d75d99ba8bbf43', 'request_id': 'req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.839249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '956d7e727788490d85d75d99ba8bbf43', 'request_id': 'req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.842794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:03.844014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:03.851349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] The token cache is being invalidate because project 956d7e727788490d85d75d99ba8bbf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:03.851705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.852570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:03.854327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1109/2187] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:03 2022] DELETE /identity/v3/projects/956d7e727788490d85d75d99ba8bbf43 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:03.858462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:03.859960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:03.921673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1079/2188] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:17:03.931429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:03.932816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:03.947547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c1b6d-6a80-49a7-bf2f-7d57f34a0279 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:03.952212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:03.952999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:03.953282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:03.953558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] PATH_INFO: `/v3/users/42924863b45841069c0aeae46b7e1591` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:03.955652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42924863b45841069c0aeae46b7e1591)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:03.956991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.009076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a221a68-d564-4747-b40c-4022cad8e142 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:04.016645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:04.017399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.018102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.018497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.022823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:04.026295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42924863b45841069c0aeae46b7e1591'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.034088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:04.036270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.039781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42924863b45841069c0aeae46b7e1591'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.040695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42924863b45841069c0aeae46b7e1591'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.047727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1080/2189] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:17:04.059224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42924863b45841069c0aeae46b7e1591'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.068523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42924863b45841069c0aeae46b7e1591'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.078068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1110/2190] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:03 2022] DELETE /identity/v3/users/42924863b45841069c0aeae46b7e1591 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:04.420066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:04.421620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:04.452952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381564-7108-4059-aea1-bfdc918d11f2 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:04.466085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:04.467619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:04.550982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abb30e-1362-4cd3-ae50-edc594be3166 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:04.558590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:04.559236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.559512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:04.560176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.560255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.560433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] PATH_INFO: `/v3/projects/2b578191690948b9b3e20740d5973861` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.560539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.561055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] PATH_INFO: `/v3/projects/a41389c784704914b55cd7d8a72cd0ae` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.561857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b578191690948b9b3e20740d5973861)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:04.562179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41389c784704914b55cd7d8a72cd0ae)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:04.564110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.564216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.573985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:04.622744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b578191690948b9b3e20740d5973861', 'request_id': 'req-2aa74e5f-017d-4287-86d4-e980973121bf'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.625433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41389c784704914b55cd7d8a72cd0ae', 'request_id': 'req-aaed92af-597c-4582-af21-d954440d59e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.632363 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b578191690948b9b3e20740d5973861', 'request_id': 'req-2aa74e5f-017d-4287-86d4-e980973121bf'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.635114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41389c784704914b55cd7d8a72cd0ae', 'request_id': 'req-aaed92af-597c-4582-af21-d954440d59e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.641802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41389c784704914b55cd7d8a72cd0ae', 'request_id': 'req-aaed92af-597c-4582-af21-d954440d59e3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.642398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b578191690948b9b3e20740d5973861', 'request_id': 'req-2aa74e5f-017d-4287-86d4-e980973121bf'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.654205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] The token cache is being invalidate because project a41389c784704914b55cd7d8a72cd0ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:04.655257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.655545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.655661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] The token cache is being invalidate because project 2b578191690948b9b3e20740d5973861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:04.655983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.656814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2aa74e5f-017d-4287-86d4-e980973121bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.658026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1081/2191] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:04 2022] DELETE /identity/v3/projects/a41389c784704914b55cd7d8a72cd0ae => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:04.658700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1111/2192] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:04 2022] DELETE /identity/v3/projects/2b578191690948b9b3e20740d5973861 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:04.672422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:04.672606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb690f-cca5-40c5-9b1c-0e12af5ce1f1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.672710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:04.672787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb690f-cca5-40c5-9b1c-0e12af5ce1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.672787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb690f-cca5-40c5-9b1c-0e12af5ce1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.691209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-abcb690f-cca5-40c5-9b1c-0e12af5ce1f1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:04.693008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-abcb690f-cca5-40c5-9b1c-0e12af5ce1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:04.737476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed92af-597c-4582-af21-d954440d59e3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:04.741167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:04.743344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:04.743983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.744267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.744546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] PATH_INFO: `/v3/users/6a55bc0dc967448bbb86e48d2fe52633` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.745720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a55bc0dc967448bbb86e48d2fe52633)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:04.748048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.759197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1112/2193] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:04.767024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.767299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.767582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.790177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:04.791484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:04.803451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1113/2194] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:04.808288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:04.809014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a55bc0dc967448bbb86e48d2fe52633'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.817072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a55bc0dc967448bbb86e48d2fe52633'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.817840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a55bc0dc967448bbb86e48d2fe52633'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.821699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b09bda-a948-403d-8b02-d3b00d8a22dd None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:04.827724 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a55bc0dc967448bbb86e48d2fe52633'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.829806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:04.829970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a55bc0dc967448bbb86e48d2fe52633'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:04.831436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.831972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.832869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.834067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:04.834389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:04.836524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.852928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1082/2195] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:04 2022] DELETE /identity/v3/users/6a55bc0dc967448bbb86e48d2fe52633 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:04.856521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1114/2196] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:17:04.858540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:04.859993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:04.886697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:04.953071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3cb26a-b4e4-4ed7-855d-76280327c53d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:04.958387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:04.959043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:04.959325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:04.959597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:04.960244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:04.962406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:04.991148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1083/2197] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:04 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:04.995370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.007002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85cb992-62a2-4590-b389-93e02b897a58 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.066210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.067347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.067785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.068066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.068710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.070648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.095622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1115/2198] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:04 2022] POST /identity/v3/users => generated 285 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:05.099864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.111740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb958757-9ecd-4a16-a7ea-b39df7221845 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.117367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.117829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.118421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.118572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.119284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.121055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.133734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1084/2199] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:05.138739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.151942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cc15d-9737-44f1-b5ce-45769b4fb2ed admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.157376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.158220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.158503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.158779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.159464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.161351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.174044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1116/2200] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:05.179048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.183731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.186778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:05.193876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf117b-af82-4ae3-a527-58f249bdf2b5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.201559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19022aec-6f60-44f3-9e17-2814fa5fb29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.202637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022aec-6f60-44f3-9e17-2814fa5fb29c admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.203033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022aec-6f60-44f3-9e17-2814fa5fb29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.203454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19022aec-6f60-44f3-9e17-2814fa5fb29c admin admin] PATH_INFO: `/v3/projects/79284246c8904f42a511f27a6f816793/users/22cb3e45bb9c4065bc91fb7f3dfe95ed/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.204932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb733-9750-4c15-a3e7-f517d2b5298d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.215021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.216551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.216960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.217344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] PATH_INFO: `/v3/projects/3376459e16094b269f5a42facb11c633` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.218965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] RBAC: Authorizing `identity:delete_project(project_id=3376459e16094b269f5a42facb11c633)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.223467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.228070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022aec-6f60-44f3-9e17-2814fa5fb29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79284246c8904f42a511f27a6f816793, user_id=22cb3e45bb9c4065bc91fb7f3dfe95ed, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.231229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19022aec-6f60-44f3-9e17-2814fa5fb29c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.260964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1085/2201] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:05 2022] PUT /identity/v3/projects/79284246c8904f42a511f27a6f816793/users/22cb3e45bb9c4065bc91fb7f3dfe95ed/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:05.266191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.266530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.266800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.290401 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3376459e16094b269f5a42facb11c633', 'request_id': 'req-e3650797-084a-4ef1-81d4-373c723a54da'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.300591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3376459e16094b269f5a42facb11c633', 'request_id': 'req-e3650797-084a-4ef1-81d4-373c723a54da'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.309435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] MFA Rules not processed for user `22cb3e45bb9c4065bc91fb7f3dfe95ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:05.311478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:05.314204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3376459e16094b269f5a42facb11c633', 'request_id': 'req-e3650797-084a-4ef1-81d4-373c723a54da'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.333411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] The token cache is being invalidate because project 3376459e16094b269f5a42facb11c633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:05.333737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.334458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.339232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1117/2202] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:05 2022] DELETE /identity/v3/projects/3376459e16094b269f5a42facb11c633 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:05.340899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.343251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:05.415991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1086/2203] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:05.419375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:05.435891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:05.437956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:05.483834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3650797-084a-4ef1-81d4-373c723a54da admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.496792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.497733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.498680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.499188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] PATH_INFO: `/v3/users/46c11863d0b445efa3032f83b99bad13` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.500398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c11863d0b445efa3032f83b99bad13)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.507394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.526764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d2c70-403f-46eb-a29a-fed87fd688cf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:05.531849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:05.532548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:05.533037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:05.533384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:05.551653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:05.555421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:05.558727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:05.567485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1087/2204] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:05.589402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c11863d0b445efa3032f83b99bad13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.597581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c11863d0b445efa3032f83b99bad13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.598459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c11863d0b445efa3032f83b99bad13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.614183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c11863d0b445efa3032f83b99bad13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.624029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00737404-b26f-47b4-8a1a-137702c66c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c11863d0b445efa3032f83b99bad13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:05.632324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1118/2205] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:05 2022] DELETE /identity/v3/users/46c11863d0b445efa3032f83b99bad13 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:06.021591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.034209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d4a15-68f9-4ab4-80c7-fba2c6d9a360 service glance] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.126612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.127424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.127794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.128160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] PATH_INFO: `/v3/projects/d77bf644db994d4daf294737b8f39c3a` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.130130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d77bf644db994d4daf294737b8f39c3a)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.134457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.193661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd77bf644db994d4daf294737b8f39c3a', 'request_id': 'req-f726eb9e-d236-4dce-bc40-e7183a867c34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:06.203896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd77bf644db994d4daf294737b8f39c3a', 'request_id': 'req-f726eb9e-d236-4dce-bc40-e7183a867c34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:06.212396 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd77bf644db994d4daf294737b8f39c3a', 'request_id': 'req-f726eb9e-d236-4dce-bc40-e7183a867c34'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:06.225390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] The token cache is being invalidate because project d77bf644db994d4daf294737b8f39c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:06.226011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:06.226826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-f726eb9e-d236-4dce-bc40-e7183a867c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:06.228400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1088/2206] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:06 2022] DELETE /identity/v3/projects/d77bf644db994d4daf294737b8f39c3a => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:06.233429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921f09-1080-402c-917c-de0c6110465f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.233757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921f09-1080-402c-917c-de0c6110465f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.234057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54921f09-1080-402c-917c-de0c6110465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.255273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-54921f09-1080-402c-917c-de0c6110465f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:06.256503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-54921f09-1080-402c-917c-de0c6110465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:06.322622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1119/2207] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:17:06.330451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.330748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.331031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.355535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:06.356781 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:06.364973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1089/2208] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:06.369282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54921f09-1080-402c-917c-de0c6110465f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.380655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54921f09-1080-402c-917c-de0c6110465f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.385293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.385938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.386381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.386545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.387179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:06.387696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.389099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.403228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1120/2209] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:06.408113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.417869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fca643-273f-4a9c-981a-58c63e5ef122 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.422631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.423500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.423791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.424067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.424715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.426933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.455944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1090/2210] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:06 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:06.460842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.473080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275ff95f-3daa-415b-8c9b-5ec1edca696a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.520362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:06.558170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.558813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.559097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.560566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.561237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.563383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.587955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1121/2211] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:06 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:06.592670 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.605193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b922a3c-be18-4d44-a727-a4548e7bf931 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.610782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6f72b8-231d-4a82-b584-34d60f321376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.611902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f72b8-231d-4a82-b584-34d60f321376 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.612196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f72b8-231d-4a82-b584-34d60f321376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.612463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f72b8-231d-4a82-b584-34d60f321376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.613363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f72b8-231d-4a82-b584-34d60f321376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.616173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6f72b8-231d-4a82-b584-34d60f321376 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.635177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1091/2212] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:06.637881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.638370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6460f5-71fe-4cd1-aeb5-85c1c2554a49 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.638674 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6460f5-71fe-4cd1-aeb5-85c1c2554a49 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.638952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6460f5-71fe-4cd1-aeb5-85c1c2554a49 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.641019 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1092/2213] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:17:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:17:06.651277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae8296-f289-4120-9544-026c968ff09c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.656574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.657605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.658033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.658314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.658980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.662121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.667921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.669594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.669944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.677477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1122/2214] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:06.682900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.701806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] MFA Rules not processed for user `b0af289f07d14247a60083dcc34197a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:06.703310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:06.714647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca45bc-5a6a-4f1e-aa14-c80c7c17fa36 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.731165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6803f883-8882-468f-bef5-39291e03ad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.731858 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f883-8882-468f-bef5-39291e03ad9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.732161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f883-8882-468f-bef5-39291e03ad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.732428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6803f883-8882-468f-bef5-39291e03ad9b admin admin] PATH_INFO: `/v3/projects/5c3cbe22b72f4153b41bd83a63997bbb/users/370378e5cdcd42abaea86ee40929c90f/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.759705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803f883-8882-468f-bef5-39291e03ad9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3cbe22b72f4153b41bd83a63997bbb, user_id=370378e5cdcd42abaea86ee40929c90f, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:06.763119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6803f883-8882-468f-bef5-39291e03ad9b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:06.808839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1123/2215] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:06 2022] PUT /identity/v3/projects/5c3cbe22b72f4153b41bd83a63997bbb/users/370378e5cdcd42abaea86ee40929c90f/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:06.819341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:06.820260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.820552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.820886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:06.854628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1093/2216] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:06.855917 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] MFA Rules not processed for user `370378e5cdcd42abaea86ee40929c90f`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:06.857141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:06.868160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.872454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:06.894690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f0ca6-7bed-4377-ac25-225708f278f3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:06.960650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1124/2217] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:17:06.972118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:06.974300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:06.984811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:06.986367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:06.987112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:06.987574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:07.002693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:07.006128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:07.018418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1094/2218] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:17:07.045802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175be09-88ca-4f7c-ac8c-8f2d3a4b58f9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:07.049754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:07.050467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:07.052334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:07.052703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:07.063218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:07.064766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:07.095133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1125/2219] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:17:07.557415 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:07.559012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:07.653697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46398c69-361d-484d-8bc1-64bc93893dfd service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:07.658451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:07.659089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:07.659488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:07.659914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] PATH_INFO: `/v3/users/26a8132cb5d240a99bf726148037acf8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:07.662116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=26a8132cb5d240a99bf726148037acf8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:07.664053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:07.713065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26a8132cb5d240a99bf726148037acf8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:07.720359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26a8132cb5d240a99bf726148037acf8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:07.721041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26a8132cb5d240a99bf726148037acf8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:07.729663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26a8132cb5d240a99bf726148037acf8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:07.730445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26a8132cb5d240a99bf726148037acf8'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:07.742003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:07.756117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1095/2220] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:07 2022] DELETE /identity/v3/users/26a8132cb5d240a99bf726148037acf8 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:07.970235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:07.981848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83d757-09c5-467c-9843-aab4e240f430 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:08.008144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:08.043419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:08.044048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:08.044335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:08.044610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] PATH_INFO: `/v3/projects/dc9401cac5074ee89a44017e88bf04d5` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:08.045767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc9401cac5074ee89a44017e88bf04d5)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:08.047664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:08.095395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc9401cac5074ee89a44017e88bf04d5', 'request_id': 'req-b9dd403f-b08b-4865-922a-9efb36f16968'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.104426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc9401cac5074ee89a44017e88bf04d5', 'request_id': 'req-b9dd403f-b08b-4865-922a-9efb36f16968'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.111823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc9401cac5074ee89a44017e88bf04d5', 'request_id': 'req-b9dd403f-b08b-4865-922a-9efb36f16968'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.124589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] The token cache is being invalidate because project dc9401cac5074ee89a44017e88bf04d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:08.124811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.125476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.127214 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1126/2221] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:07 2022] DELETE /identity/v3/projects/dc9401cac5074ee89a44017e88bf04d5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:08.131665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:08.133091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:08.147850 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca7c20-e4fc-4b76-86c0-19326a3c0b9c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:08.222582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:08.223166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:08.223455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:08.223736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] PATH_INFO: `/v3/users/faa539ee67d84a7888698b16a77cd956` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:08.224912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa539ee67d84a7888698b16a77cd956)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:08.226998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:08.300354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa539ee67d84a7888698b16a77cd956'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.302161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa539ee67d84a7888698b16a77cd956'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.302883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa539ee67d84a7888698b16a77cd956'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.310759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa539ee67d84a7888698b16a77cd956'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.312109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e6feb6f-37d9-4cad-af20-4b6e2e269ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa539ee67d84a7888698b16a77cd956'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.330132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1096/2222] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:08 2022] DELETE /identity/v3/users/faa539ee67d84a7888698b16a77cd956 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:08.536740 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:08.538353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:08.561797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd403f-b08b-4865-922a-9efb36f16968 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:08.672504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:08.674640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:08.675163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:08.675653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] PATH_INFO: `/v3/projects/a4b32590ce4c421e9e28783ecf8b32e7` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:08.678760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b32590ce4c421e9e28783ecf8b32e7)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:08.682903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:08.779856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b32590ce4c421e9e28783ecf8b32e7', 'request_id': 'req-9545de68-a300-4991-ad24-d9de45969d17'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.821307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b32590ce4c421e9e28783ecf8b32e7', 'request_id': 'req-9545de68-a300-4991-ad24-d9de45969d17'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.824372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:08.854258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b32590ce4c421e9e28783ecf8b32e7', 'request_id': 'req-9545de68-a300-4991-ad24-d9de45969d17'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.892176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] The token cache is being invalidate because project a4b32590ce4c421e9e28783ecf8b32e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:08.892390 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.893098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9545de68-a300-4991-ad24-d9de45969d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:08.895973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1127/2223] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:08 2022] DELETE /identity/v3/projects/a4b32590ce4c421e9e28783ecf8b32e7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:08.903242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:08.905677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:08.906288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:08.955309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:08.958737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:09.117034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1097/2224] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:09.124073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.124577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.124666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.162981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:09.164291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:09.173336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1128/2225] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:09.178598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.195444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9eb8e-61a8-4d23-b815-62008668d1f1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.206521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.207800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.208080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.208350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.209016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:09.209317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.210965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.221728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:09.227629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1098/2226] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:09.230247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.241529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d118ffd-20d8-444b-9bf7-dfb0000d2533 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.246687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.247600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.247889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.248181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.248821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.250897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.318242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1129/2227] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:09 2022] POST /identity/v3/projects => generated 375 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:09.322342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.350806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440abbc-21b3-4cf0-8668-20e7202ffce2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.471578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.472773 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.473134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.473424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.474504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.476948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.516859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1099/2228] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:09 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:09.521077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.531787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ee41d-4210-4e57-9128-eaeb79551831 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.536844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.537556 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.537896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.538181 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.538871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.540571 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.555376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1130/2229] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:09.565357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.577039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1c0e-f95e-4cff-8e80-8e11e1b9b798 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.581956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd898e2-c4b4-46b7-b282-58624ee66ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.583278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd898e2-c4b4-46b7-b282-58624ee66ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.583718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd898e2-c4b4-46b7-b282-58624ee66ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.583999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd898e2-c4b4-46b7-b282-58624ee66ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.584755 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd898e2-c4b4-46b7-b282-58624ee66ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.586589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd898e2-c4b4-46b7-b282-58624ee66ac0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.601042 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1100/2230] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:09.605301 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.618738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e911f2ad-09ed-4e5e-958b-9b2ab4055eb5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.627879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.629180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.629857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.630341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] PATH_INFO: `/v3/projects/2936a6392dc44db6ba5f64a510ccf9ea/users/a01ab63f425143789156055d6479cd46/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.651446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2936a6392dc44db6ba5f64a510ccf9ea, user_id=a01ab63f425143789156055d6479cd46, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.654910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.672002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1131/2231] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:09 2022] PUT /identity/v3/projects/2936a6392dc44db6ba5f64a510ccf9ea/users/a01ab63f425143789156055d6479cd46/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:09.682665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf797-c30a-483c-8031-8dc5b939d631 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.682957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf797-c30a-483c-8031-8dc5b939d631 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.683359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201cf797-c30a-483c-8031-8dc5b939d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.729691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-201cf797-c30a-483c-8031-8dc5b939d631 None None] MFA Rules not processed for user `a01ab63f425143789156055d6479cd46`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:09.731089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-201cf797-c30a-483c-8031-8dc5b939d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:09.829744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1101/2232] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:09.842335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:09.844177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:09.906896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb232e19-31e1-4e66-85d5-b8c3046a7613 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:09.911755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:09.912413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:09.912690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:09.913623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:09.927727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:09.929949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:09.940030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1132/2233] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:10.713565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f880-b69c-4f8e-8884-1a9274919560 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:10.714050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f880-b69c-4f8e-8884-1a9274919560 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:10.714410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8595f880-b69c-4f8e-8884-1a9274919560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:10.734691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8595f880-b69c-4f8e-8884-1a9274919560 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:10.735996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8595f880-b69c-4f8e-8884-1a9274919560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:10.797038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1102/2234] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:17:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:10.844465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:10.845967 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:10.922027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b88c46-aa6e-4690-ae43-5f8870c3f7d7 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:10.927679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:10.928288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:10.928568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:10.928844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:10.937220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:10.938897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:10.947126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1133/2235] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:17:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:17:11.499683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d505d-60a8-4934-8cec-a262f1a1db63 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:11.500727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d505d-60a8-4934-8cec-a262f1a1db63 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:11.500727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d505d-60a8-4934-8cec-a262f1a1db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:11.529877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c71d505d-60a8-4934-8cec-a262f1a1db63 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:11.531126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c71d505d-60a8-4934-8cec-a262f1a1db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:11.540927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1103/2236] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 00:17:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:11.554680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:11.565530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8cd5bf-3496-4dbd-8ac9-b240b847fcb6 service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:11.571106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:11.571715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:11.572013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:11.572290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:11.582524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:11.584241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:11.592821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1134/2237] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:17:11.855905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9ea0-cb66-44d8-b708-639b29c2e1a5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:11.856408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9ea0-cb66-44d8-b708-639b29c2e1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:11.856557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f9ea0-cb66-44d8-b708-639b29c2e1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:11.872474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:11.883345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-543f9ea0-cb66-44d8-b708-639b29c2e1a5 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:11.884534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-543f9ea0-cb66-44d8-b708-639b29c2e1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:11.892325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1104/2238] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:17:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:11.906098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:11.913193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:11.937329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11178222-f1ed-41c1-80ca-b633cf01b623 service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:11.937329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:11.937329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:11.937329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:11.937667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:11.943560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:11.946127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:11.955479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1135/2239] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:17:12.408287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e87bb-6711-4784-9e23-514dafcd0acd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:12.408429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e87bb-6711-4784-9e23-514dafcd0acd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:12.408870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e87bb-6711-4784-9e23-514dafcd0acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:12.431659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-600e87bb-6711-4784-9e23-514dafcd0acd None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:12.432984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-600e87bb-6711-4784-9e23-514dafcd0acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:12.442683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1105/2240] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 00:17:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:12.459308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:12.468527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efe26-77f6-466a-890c-3275c1a4938a service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:12.477410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:12.478071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:12.478356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:12.478650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:12.487634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:12.489334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:12.497614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1136/2241] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:17:13.331683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb663-af9a-4508-9c5c-5ba85ff92c2d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:13.332694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb663-af9a-4508-9c5c-5ba85ff92c2d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:13.332808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644cb663-af9a-4508-9c5c-5ba85ff92c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:13.357417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-644cb663-af9a-4508-9c5c-5ba85ff92c2d None None] MFA Rules not processed for user `a7a214f6d0fa424e8c54e1934e0a6fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:13.361630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-644cb663-af9a-4508-9c5c-5ba85ff92c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:13.425168 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1106/2242] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:14.873088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:14.874543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:14.954924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14eb99-a098-4db9-9d5b-b1c12dc2547f service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:14.959950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:14.960586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:14.960864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:14.961139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] PATH_INFO: `/v3/users/af512a6a991943a3b310cd0dacdd1843` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:14.962452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af512a6a991943a3b310cd0dacdd1843)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:14.964381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:15.025991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af512a6a991943a3b310cd0dacdd1843'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.033437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af512a6a991943a3b310cd0dacdd1843'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.034189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af512a6a991943a3b310cd0dacdd1843'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.053537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af512a6a991943a3b310cd0dacdd1843'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.062246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af512a6a991943a3b310cd0dacdd1843'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.070207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1137/2243] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:14 2022] DELETE /identity/v3/users/af512a6a991943a3b310cd0dacdd1843 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:15.074791 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.075419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.075585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.096069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:15.097348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:15.166882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1107/2244] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:15.177482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:15.179073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:15.244638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafe193-4e24-473a-9c18-16931355cba6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:15.248445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0fb6f-1735-4f58-8236-8c1034c2e07c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:15.249151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0fb6f-1735-4f58-8236-8c1034c2e07c service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.249456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0fb6f-1735-4f58-8236-8c1034c2e07c service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.249912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0fb6f-1735-4f58-8236-8c1034c2e07c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.260137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0fb6f-1735-4f58-8236-8c1034c2e07c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:15.261563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff0fb6f-1735-4f58-8236-8c1034c2e07c service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:15.265498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:15.274221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1138/2245] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:15.492598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:15.494729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:15.510293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962aee8-8c75-4bfa-94d2-ebc74ef9e440 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:15.518484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:15.520276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.521150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.521543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] PATH_INFO: `/v3/projects/e2b81057b3f34d4eab87a41c5180a74d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.523051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2b81057b3f34d4eab87a41c5180a74d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:15.525390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:15.591575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2b81057b3f34d4eab87a41c5180a74d', 'request_id': 'req-3f46ed9f-67c5-4197-bd25-434810f1d50e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.599456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2b81057b3f34d4eab87a41c5180a74d', 'request_id': 'req-3f46ed9f-67c5-4197-bd25-434810f1d50e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.606202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2b81057b3f34d4eab87a41c5180a74d', 'request_id': 'req-3f46ed9f-67c5-4197-bd25-434810f1d50e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.623371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] The token cache is being invalidate because project e2b81057b3f34d4eab87a41c5180a74d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:15.623666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.624337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-3f46ed9f-67c5-4197-bd25-434810f1d50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:15.625909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1108/2246] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:15 2022] DELETE /identity/v3/projects/e2b81057b3f34d4eab87a41c5180a74d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:15.631715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.632127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.632471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.654852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:15.656088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:15.732634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1139/2247] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:15.742068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.742529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.743241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.795586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:15.797484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:15.818813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1109/2248] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:15.824486 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:15.835707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3aa5a-1563-4204-9cf7-3ffd5b19af16 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:15.840902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:15.857755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.858203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.858476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.859193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:15.859652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:15.861276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:15.876007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1140/2249] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:15.881292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:15.895359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7baa2ba-1251-4c8e-8871-b11dc915285e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:15.907088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:15.907711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:15.907999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:15.908276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:15.909282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:15.912887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:15.951320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:15.975974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1110/2250] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:15 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:15.976204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:15.991613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2a368-c621-4a64-86b7-f1925a685825 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:16.169561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:16.169887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:16.170171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:16.170446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:16.171093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:16.173961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:16.231348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1141/2251] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:15 2022] POST /identity/v3/users => generated 291 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:16.235461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:16.248424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc858df0-59c1-4a74-93e0-e7084989c7d2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:16.255077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:16.256023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:16.256669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:16.257385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:16.262470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:16.265894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:16.314405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1111/2252] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:16.318942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:16.339041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65ebac-de0d-442d-8709-995479c5e5dc admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:16.349721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb232ac-258b-4136-a2e4-292344eb3414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:16.351719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb232ac-258b-4136-a2e4-292344eb3414 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:16.352922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb232ac-258b-4136-a2e4-292344eb3414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:16.353578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb232ac-258b-4136-a2e4-292344eb3414 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:16.354332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb232ac-258b-4136-a2e4-292344eb3414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:16.359495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb232ac-258b-4136-a2e4-292344eb3414 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:16.384618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1142/2253] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:16.385393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:16.399047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff8050-878d-493b-9717-d7c47c3bf38e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:16.406786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:16.407995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:16.408841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:16.409460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] PATH_INFO: `/v3/projects/6fba87e20fcc484789037ad39a8728c2/users/384b994ced0847d9856458735987de42/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:16.439719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fba87e20fcc484789037ad39a8728c2, user_id=384b994ced0847d9856458735987de42, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:16.443138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:16.460028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1112/2254] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:16 2022] PUT /identity/v3/projects/6fba87e20fcc484789037ad39a8728c2/users/384b994ced0847d9856458735987de42/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:16.465292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bae72-53b1-43bf-8a43-f571cb0a3532 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:16.465750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bae72-53b1-43bf-8a43-f571cb0a3532 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:16.466060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679bae72-53b1-43bf-8a43-f571cb0a3532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:16.497965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-679bae72-53b1-43bf-8a43-f571cb0a3532 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:16.500636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-679bae72-53b1-43bf-8a43-f571cb0a3532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:16.610594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1143/2255] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:16.622891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:16.624662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:16.754349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce0c87-d6b9-45c5-87e9-b2c48e794abc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:16.760440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:16.761475 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:16.761968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:16.763016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:16.792497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:16.794259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:16.815981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1113/2256] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:17:17.801075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149aff0-04ed-4fac-9677-00b185ad994d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:17.801530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149aff0-04ed-4fac-9677-00b185ad994d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:17.801880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149aff0-04ed-4fac-9677-00b185ad994d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:17.817425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:17.898017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1149aff0-04ed-4fac-9677-00b185ad994d None None] MFA Rules not processed for user `384b994ced0847d9856458735987de42`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:17.903498 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1149aff0-04ed-4fac-9677-00b185ad994d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:18.137614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1144/2257] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:18.152522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:18.154693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:18.293201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c42c7-2206-4e39-be79-e73b350a09d7 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:18.296746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:18.297442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:18.297869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:18.298206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:18.315307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:18.319049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:18.339491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1114/2258] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:19.735889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236254aa-269a-4a0e-9f31-26e8317ffb6b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:19.736371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236254aa-269a-4a0e-9f31-26e8317ffb6b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:19.736490 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236254aa-269a-4a0e-9f31-26e8317ffb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:19.757140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-236254aa-269a-4a0e-9f31-26e8317ffb6b None None] MFA Rules not processed for user `384b994ced0847d9856458735987de42`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:19.758383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-236254aa-269a-4a0e-9f31-26e8317ffb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:19.765546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1145/2259] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:23.418584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:23.420128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:23.433586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345ab59-d007-440e-8947-96d9ad10843d service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:23.438257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:23.438894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:23.439194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:23.439469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] PATH_INFO: `/v3/users/a01ab63f425143789156055d6479cd46` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:23.440712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01ab63f425143789156055d6479cd46)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:23.443100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:23.497262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01ab63f425143789156055d6479cd46'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:23.505560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01ab63f425143789156055d6479cd46'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:23.506343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01ab63f425143789156055d6479cd46'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:23.510028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:23.522716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01ab63f425143789156055d6479cd46'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:23.523507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01ab63f425143789156055d6479cd46'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:23.553195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1115/2260] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:23 2022] DELETE /identity/v3/users/a01ab63f425143789156055d6479cd46 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:23.557375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:23.557934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:23.558046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:23.589766 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:23.591328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:23.682121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1146/2261] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:23.706932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:23.709081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:23.803030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4a7a5-b649-45ba-9937-a99c0ecacfd7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:23.806797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df44a6ec-92ec-4fba-b38f-a528de44f2ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:23.807407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a6ec-92ec-4fba-b38f-a528de44f2ea service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:23.807780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a6ec-92ec-4fba-b38f-a528de44f2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:23.808076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df44a6ec-92ec-4fba-b38f-a528de44f2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:23.818483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44a6ec-92ec-4fba-b38f-a528de44f2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:23.820015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df44a6ec-92ec-4fba-b38f-a528de44f2ea service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:23.830114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1116/2262] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:17:24.231781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.233322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:24.247388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b6ebf-4805-48f3-a1b3-c1febac23622 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.252159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.252800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.253202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.253482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] PATH_INFO: `/v3/projects/2936a6392dc44db6ba5f64a510ccf9ea` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.255553 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2936a6392dc44db6ba5f64a510ccf9ea)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.257642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.320109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2936a6392dc44db6ba5f64a510ccf9ea', 'request_id': 'req-3fd60def-1e1e-4fec-bbf8-877ac2c94955'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:24.332946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2936a6392dc44db6ba5f64a510ccf9ea', 'request_id': 'req-3fd60def-1e1e-4fec-bbf8-877ac2c94955'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:24.339883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2936a6392dc44db6ba5f64a510ccf9ea', 'request_id': 'req-3fd60def-1e1e-4fec-bbf8-877ac2c94955'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:24.355034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] The token cache is being invalidate because project 2936a6392dc44db6ba5f64a510ccf9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:24.355674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:24.356712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3fd60def-1e1e-4fec-bbf8-877ac2c94955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:24.358638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1147/2263] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:24 2022] DELETE /identity/v3/projects/2936a6392dc44db6ba5f64a510ccf9ea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:24.364823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.365120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.365394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.390017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:24.394285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:24.472008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1117/2264] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:24.480861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.481169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.482079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.504894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:24.506260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:24.517427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1148/2265] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:24.519057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.530072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8edbb-097f-4e3f-afe0-762f27758304 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.534946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.535620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.536083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.536185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.537251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:24.537251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.538941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.551043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1118/2266] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:24.555621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.562016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:24.567628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461c14ca-de80-4ce0-932d-9c70f20bcf7e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.578904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.579547 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.579835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.580107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.580758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.583583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.611000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1149/2267] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:24 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:24.615555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.625747 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8e1c6-e9b6-4229-92f9-4436e940dd00 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.687705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.688327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.688607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.688883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.689553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.692224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.704186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:24.715851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1119/2268] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:24 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:24.719976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.733647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fae0f3-3f6a-4759-91c2-dd85251f70b7 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.739283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.740103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.740388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.740662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.741319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.742976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.753378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1150/2269] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:24.758212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.769072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a8468-28bc-4f03-bf66-55d2bef4e513 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.774840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3953151-bfc0-4ef4-93fc-b1eb3fc5dc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.775456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953151-bfc0-4ef4-93fc-b1eb3fc5dc51 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.776122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953151-bfc0-4ef4-93fc-b1eb3fc5dc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.776122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3953151-bfc0-4ef4-93fc-b1eb3fc5dc51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.776661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3953151-bfc0-4ef4-93fc-b1eb3fc5dc51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.778360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3953151-bfc0-4ef4-93fc-b1eb3fc5dc51 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.789744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1120/2270] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:24.793979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.805682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b0de-ceb0-464c-91d5-83448e9a86dd admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:24.810534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:24.811209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.811510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.811788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] PATH_INFO: `/v3/projects/98378b1f743447fa980d5ed7f824e3c0/users/d840aff89337466098a93d7f988c8a16/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.827905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98378b1f743447fa980d5ed7f824e3c0, user_id=d840aff89337466098a93d7f988c8a16, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:24.830607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:24.844993 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1151/2271] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:24 2022] PUT /identity/v3/projects/98378b1f743447fa980d5ed7f824e3c0/users/d840aff89337466098a93d7f988c8a16/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:24.855593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:24.855880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:24.856156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:24.890349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] MFA Rules not processed for user `d840aff89337466098a93d7f988c8a16`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:24.891575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:24.975359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1121/2272] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:24.986201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:24.987991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:25.052964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7d4c6-d128-495e-9f23-3f09fdc015a3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:25.058426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df9859-63eb-45af-a962-d6f2652fccb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:25.058822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df9859-63eb-45af-a962-d6f2652fccb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:25.059105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df9859-63eb-45af-a962-d6f2652fccb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:25.059495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df9859-63eb-45af-a962-d6f2652fccb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:25.069000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df9859-63eb-45af-a962-d6f2652fccb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:25.070767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df9859-63eb-45af-a962-d6f2652fccb8 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:25.080085 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1152/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:28.877020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:29.030900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f4d0-a839-4776-a75b-25000a8009ea None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:29.053202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:29.054036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:29.054319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:29.054593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] PATH_INFO: `/v3/users/d840aff89337466098a93d7f988c8a16` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:29.056405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d840aff89337466098a93d7f988c8a16)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:29.059053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:29.200963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd840aff89337466098a93d7f988c8a16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.211571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd840aff89337466098a93d7f988c8a16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.212681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd840aff89337466098a93d7f988c8a16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.222269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd840aff89337466098a93d7f988c8a16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.223303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd840aff89337466098a93d7f988c8a16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.235860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:29.247014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1122/2274] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:28 2022] DELETE /identity/v3/users/d840aff89337466098a93d7f988c8a16 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:29.251666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:29.252144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:29.252266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:29.272778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:29.274175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:29.351664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1153/2275] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:17:29.361295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:29.362728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:29.438571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e9059-ee6f-4052-843a-c0a096932e36 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:29.445802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22fc50c-82c5-4ceb-ab02-7afde82aee83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:29.446710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc50c-82c5-4ceb-ab02-7afde82aee83 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:29.447287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc50c-82c5-4ceb-ab02-7afde82aee83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:29.447738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22fc50c-82c5-4ceb-ab02-7afde82aee83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:29.462905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fc50c-82c5-4ceb-ab02-7afde82aee83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:29.464903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22fc50c-82c5-4ceb-ab02-7afde82aee83 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:29.489110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1123/2276] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:29.855767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:29.857346 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:29.878795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cbddc-0f79-4fab-86e1-ed2a44b413be None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:29.884664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:29.885343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:29.885638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:29.885966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] PATH_INFO: `/v3/projects/98378b1f743447fa980d5ed7f824e3c0` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:29.887132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98378b1f743447fa980d5ed7f824e3c0)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:29.889246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:29.952109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:29.963066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98378b1f743447fa980d5ed7f824e3c0', 'request_id': 'req-3c62ad3a-7ae4-401f-94cc-027a5ba18192'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.972197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98378b1f743447fa980d5ed7f824e3c0', 'request_id': 'req-3c62ad3a-7ae4-401f-94cc-027a5ba18192'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.981338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98378b1f743447fa980d5ed7f824e3c0', 'request_id': 'req-3c62ad3a-7ae4-401f-94cc-027a5ba18192'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.994633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] The token cache is being invalidate because project 98378b1f743447fa980d5ed7f824e3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:29.994925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:29.995715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-3c62ad3a-7ae4-401f-94cc-027a5ba18192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:30.001674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1154/2277] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:29 2022] DELETE /identity/v3/projects/98378b1f743447fa980d5ed7f824e3c0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:30.003315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.003799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.003908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.042093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:30.042093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:30.099587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1124/2278] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:30.107632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.107951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.108230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.128215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:30.130070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:30.138612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1155/2279] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:30.143157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.154967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957bde74-84dc-41f5-b840-2a12269c8088 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.159727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.161513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.161843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.162119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.162768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:30.163069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.164739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.176689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1125/2280] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:30.181063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.190193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284e953-1201-4e6b-b1ec-2524769043ab None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.195044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.195602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.195883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.196153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.196792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.198721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.227914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1156/2281] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:30.232004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.242609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d623527-81f1-4111-992a-74ee894b3dc1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.308917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.309520 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.309845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.310196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.310831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.313161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.343333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1126/2282] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:30.345145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.358431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95ecfa-fe0c-4db5-b6a2-85c3a6fff4a5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.363287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.363914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.364217 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.364493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.365140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.366759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.377648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1157/2283] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:30.381392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.391677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe43c1-2d58-46e1-8c19-b452748dd490 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.397444 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545d6ad-9f18-4fb5-bad7-7a4e265c98b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.398091 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545d6ad-9f18-4fb5-bad7-7a4e265c98b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.398380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545d6ad-9f18-4fb5-bad7-7a4e265c98b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.398663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545d6ad-9f18-4fb5-bad7-7a4e265c98b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.399568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545d6ad-9f18-4fb5-bad7-7a4e265c98b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.401210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545d6ad-9f18-4fb5-bad7-7a4e265c98b6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.414203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1127/2284] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:30.418684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.431042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a30d5e7-cb9a-42c4-ae06-d3171571b41b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.435986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.436909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.437196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.437471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] PATH_INFO: `/v3/projects/817fe8e69c4f4dd99150d991d1be877a/users/62d09f174f9b400dacf32bb4f5fd74be/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.459096 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817fe8e69c4f4dd99150d991d1be877a, user_id=62d09f174f9b400dacf32bb4f5fd74be, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.461823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.475758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1158/2285] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:30 2022] PUT /identity/v3/projects/817fe8e69c4f4dd99150d991d1be877a/users/62d09f174f9b400dacf32bb4f5fd74be/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:30.487007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.487301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.487576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.495519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:30.525410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] MFA Rules not processed for user `62d09f174f9b400dacf32bb4f5fd74be`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:30.526699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:30.623648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1128/2286] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:30.635163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.712340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d10f89-a0fc-435f-8d99-98377dd4fe53 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.717497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.718185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.718473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.718752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.719399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.721321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.757790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1159/2287] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:30.759554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.774271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f6d52-2a2b-48ab-924b-0a97ba2d7e8b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.873499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.874505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.876614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.876902 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.877564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.880722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.915514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1129/2288] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:30 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:30.916731 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.935658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54120165-ed71-4cac-a975-36d596212abf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.943362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.944849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.944974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.945160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.945982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.947730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:30.963717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1160/2289] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:30.964885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:30.980550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d47fe-efb8-4ec6-ad6c-ab423688c081 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:30.985996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0223-5687-4777-992d-52bb71bec707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:30.986586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0223-5687-4777-992d-52bb71bec707 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:30.986830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0223-5687-4777-992d-52bb71bec707 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:30.987222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0223-5687-4777-992d-52bb71bec707 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:30.987753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0223-5687-4777-992d-52bb71bec707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:30.990006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0223-5687-4777-992d-52bb71bec707 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.005956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1130/2290] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:31.007578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.017951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc1f058-e786-4ee2-b7ef-eb4d01d6f70d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.022793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.023461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.023770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.024029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] PATH_INFO: `/v3/projects/78f372c43896470d8158ca4ff90dea2d/users/0fd3b8de586f4e6b93aa2d204a3c9fc5/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.040966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f372c43896470d8158ca4ff90dea2d, user_id=0fd3b8de586f4e6b93aa2d204a3c9fc5, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.043654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.058204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1161/2291] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:31 2022] PUT /identity/v3/projects/78f372c43896470d8158ca4ff90dea2d/users/0fd3b8de586f4e6b93aa2d204a3c9fc5/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:31.068657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.069032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.069383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.102348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] MFA Rules not processed for user `0fd3b8de586f4e6b93aa2d204a3c9fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:31.103575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:31.170709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:31.174644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1131/2292] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:31.179644 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.203105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:31.254819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a4c6f-6f1d-4982-b9f6-ec86f25481b4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.260005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.260621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.260904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.261469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.262167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.264126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.305920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1162/2293] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:31 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:17:31.311151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.327909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285fa96-50de-4b7a-af56-5fa2a8141c2e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.485033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.486083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.486435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.486813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.487566 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.489887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.526451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1132/2294] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:31 2022] POST /identity/v3/users => generated 294 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:31.527676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.540185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0358c33d-0313-49de-ae13-c7ff44369cf3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.544904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.545587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.545975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.546594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.547274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.548846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.560131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1163/2295] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:31.564414 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.574728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c7b52-a0f7-4b71-86d7-5ecefb0e3cdc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.579942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.580869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.581252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.581659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] PATH_INFO: `/v3/projects/7d88e001da0f4fb08fbd3eb945ba259d/users/35061af0b06b40b4ae62b2335c8aa26d/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.600634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d88e001da0f4fb08fbd3eb945ba259d, user_id=35061af0b06b40b4ae62b2335c8aa26d, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.603394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.621257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1133/2296] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:31 2022] PUT /identity/v3/projects/7d88e001da0f4fb08fbd3eb945ba259d/users/35061af0b06b40b4ae62b2335c8aa26d/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:31.624985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.635619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4665db4-d3ee-4121-8d27-278de5ce6401 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.713516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea29a-8ac2-4d88-a9e6-3a811a223f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.714241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea29a-8ac2-4d88-a9e6-3a811a223f73 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.714468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea29a-8ac2-4d88-a9e6-3a811a223f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.714723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea29a-8ac2-4d88-a9e6-3a811a223f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.715366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ea29a-8ac2-4d88-a9e6-3a811a223f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.716957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ea29a-8ac2-4d88-a9e6-3a811a223f73 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.728153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1164/2297] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:31.732477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.742964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146144c-95c8-4ba4-96d9-bd1d0508be53 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:31.748458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:31.749122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.749405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.749718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] PATH_INFO: `/v3/projects/7d88e001da0f4fb08fbd3eb945ba259d/users/35061af0b06b40b4ae62b2335c8aa26d/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.751614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d88e001da0f4fb08fbd3eb945ba259d, user_id=35061af0b06b40b4ae62b2335c8aa26d, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:31.754469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:31.765975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1134/2298] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:31 2022] PUT /identity/v3/projects/7d88e001da0f4fb08fbd3eb945ba259d/users/35061af0b06b40b4ae62b2335c8aa26d/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:31.777969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:31.778255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:31.778531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:31.807938 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] MFA Rules not processed for user `35061af0b06b40b4ae62b2335c8aa26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:31.809176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:31.907956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1165/2299] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:17:31.991188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:31.993460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:32.078628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec21688-ea09-4808-ae3f-1fee8256b6ea admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:32.083014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:32.083932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:32.084184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:32.084348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:32.155488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:32.155488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:32.165610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1135/2300] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:33.848958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:33.860732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf42293-fd92-475c-96e4-d546fa1c27ac None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:33.866210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:33.867031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:33.867360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:33.867823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:33.883081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:33.943260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:33.944666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:33.955445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1166/2301] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:34.667103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:34.675810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fa26e-fd3f-45ee-90b0-2410ea0b6429 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:34.679819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66528fcc-5414-4127-98fe-73c9ed1093b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:34.680419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66528fcc-5414-4127-98fe-73c9ed1093b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:34.680703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66528fcc-5414-4127-98fe-73c9ed1093b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:34.681061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66528fcc-5414-4127-98fe-73c9ed1093b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:34.687195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:34.692964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66528fcc-5414-4127-98fe-73c9ed1093b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:34.694752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66528fcc-5414-4127-98fe-73c9ed1093b3 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:34.706932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1136/2302] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:37.279590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:37.283470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:37.384794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf327b-16cf-4c7d-b880-8d3013f183d4 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:37.390252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:37.391002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:37.391359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:37.391650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] PATH_INFO: `/v3/users/22cb3e45bb9c4065bc91fb7f3dfe95ed` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:37.392809 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cb3e45bb9c4065bc91fb7f3dfe95ed)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:37.395499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:37.475465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cb3e45bb9c4065bc91fb7f3dfe95ed'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:37.485612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cb3e45bb9c4065bc91fb7f3dfe95ed'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:37.486890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cb3e45bb9c4065bc91fb7f3dfe95ed'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:37.507790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cb3e45bb9c4065bc91fb7f3dfe95ed'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:37.526053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cb3e45bb9c4065bc91fb7f3dfe95ed'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:37.537329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1167/2303] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:37 2022] DELETE /identity/v3/users/22cb3e45bb9c4065bc91fb7f3dfe95ed => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:37.541583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:37.542133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:37.542236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:37.574032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:37.575918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:37.720309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1137/2304] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:37.737666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:37.739811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:37.784175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:37.812488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125146da-e22a-45be-9efe-3ab097b2dd27 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:37.816595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:37.817619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:37.817933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:37.818204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:37.827905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:37.829329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:37.840823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1168/2305] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:38.160423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:38.165748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:38.187237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88967a7-f6a2-4102-a8ad-2d3e6dd1b9b8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:38.194549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:38.195213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:38.195552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:38.195835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] PATH_INFO: `/v3/projects/79284246c8904f42a511f27a6f816793` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:38.197041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79284246c8904f42a511f27a6f816793)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:38.199086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:38.261990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79284246c8904f42a511f27a6f816793', 'request_id': 'req-ab0bd3c3-941a-44fe-90ed-51941c653370'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:38.271587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79284246c8904f42a511f27a6f816793', 'request_id': 'req-ab0bd3c3-941a-44fe-90ed-51941c653370'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:38.280768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79284246c8904f42a511f27a6f816793', 'request_id': 'req-ab0bd3c3-941a-44fe-90ed-51941c653370'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:38.295068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] The token cache is being invalidate because project 79284246c8904f42a511f27a6f816793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:38.295366 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:38.296032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ab0bd3c3-941a-44fe-90ed-51941c653370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:38.297526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1138/2306] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:38 2022] DELETE /identity/v3/projects/79284246c8904f42a511f27a6f816793 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:38.876593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:38.877365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:38.891222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826cda3-970f-43e2-ab27-de804bba2209 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:38.971123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:38.971772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:38.972052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:38.972331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] PATH_INFO: `/v3/users/62d09f174f9b400dacf32bb4f5fd74be` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:38.973649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d09f174f9b400dacf32bb4f5fd74be)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:38.976036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:39.052135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d09f174f9b400dacf32bb4f5fd74be'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.071539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d09f174f9b400dacf32bb4f5fd74be'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.072482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d09f174f9b400dacf32bb4f5fd74be'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.096123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d09f174f9b400dacf32bb4f5fd74be'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.130058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d09f174f9b400dacf32bb4f5fd74be'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.140982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1169/2307] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:38 2022] DELETE /identity/v3/users/62d09f174f9b400dacf32bb4f5fd74be => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:39.142766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:39.143186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:39.143389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:39.164790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:39.166274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:39.273198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1139/2308] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:39.283673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:39.285119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:39.348584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660510c0-418d-40a4-b863-e428f49346be admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:39.354826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:39.355396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:39.355699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:39.355995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:39.371715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:39.373427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:39.380225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:39.391433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1170/2309] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:39.694517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:39.696864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:39.712407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa93799-aca4-41ed-81c6-3ca97ebb43e3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:39.718092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:39.718852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:39.718989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:39.719338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] PATH_INFO: `/v3/projects/817fe8e69c4f4dd99150d991d1be877a` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:39.720579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=817fe8e69c4f4dd99150d991d1be877a)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:39.722618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:39.745827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:39.788962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817fe8e69c4f4dd99150d991d1be877a', 'request_id': 'req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.796770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817fe8e69c4f4dd99150d991d1be877a', 'request_id': 'req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.804050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817fe8e69c4f4dd99150d991d1be877a', 'request_id': 'req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.814371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] The token cache is being invalidate because project 817fe8e69c4f4dd99150d991d1be877a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:39.814668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.815322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8278f92d-9b10-4d8f-8e6a-cb2d8e281864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.817494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1140/2310] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:39 2022] DELETE /identity/v3/projects/817fe8e69c4f4dd99150d991d1be877a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:39.821549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:39.831345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b70a7d-1b02-4908-a3e2-515cb1fa74cc service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:39.893502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:39.894793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:39.895069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:39.896495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] PATH_INFO: `/v3/users/0fd3b8de586f4e6b93aa2d204a3c9fc5` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:39.897912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd3b8de586f4e6b93aa2d204a3c9fc5)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:39.900276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:39.952255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd3b8de586f4e6b93aa2d204a3c9fc5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.959969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd3b8de586f4e6b93aa2d204a3c9fc5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.960725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd3b8de586f4e6b93aa2d204a3c9fc5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.973771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd3b8de586f4e6b93aa2d204a3c9fc5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.981876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd3b8de586f4e6b93aa2d204a3c9fc5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:39.989038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1171/2311] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:39 2022] DELETE /identity/v3/users/0fd3b8de586f4e6b93aa2d204a3c9fc5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:40.316864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:40.317457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:40.317457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:40.344101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] MFA Rules not processed for user `ea5524cca92f42c3841e74995edee832`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:40.345331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:40.417211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:40.418782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:40.433576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1141/2312] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:40.497018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505d6f6-5cfb-4d08-9b43-bd11f2374c2b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:40.502918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:40.503565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:40.503847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:40.504151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] PATH_INFO: `/v3/projects/78f372c43896470d8158ca4ff90dea2d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:40.505306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f372c43896470d8158ca4ff90dea2d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:40.507991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:40.537952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:40.565422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f372c43896470d8158ca4ff90dea2d', 'request_id': 'req-c9878344-98b7-4819-b305-3dfab7c0f554'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.573431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f372c43896470d8158ca4ff90dea2d', 'request_id': 'req-c9878344-98b7-4819-b305-3dfab7c0f554'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.579943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f372c43896470d8158ca4ff90dea2d', 'request_id': 'req-c9878344-98b7-4819-b305-3dfab7c0f554'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.591725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] The token cache is being invalidate because project 78f372c43896470d8158ca4ff90dea2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:40.592106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.592866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.594395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1172/2313] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:40 2022] DELETE /identity/v3/projects/78f372c43896470d8158ca4ff90dea2d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:40.598865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:40.609587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cca07b-25f2-4770-9be3-5ab2fbd48e73 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:40.667621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:40.668256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:40.668535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:40.668804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] PATH_INFO: `/v3/users/35061af0b06b40b4ae62b2335c8aa26d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:40.669977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35061af0b06b40b4ae62b2335c8aa26d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:40.671940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:40.730239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35061af0b06b40b4ae62b2335c8aa26d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.731360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:40.740246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35061af0b06b40b4ae62b2335c8aa26d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.741105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35061af0b06b40b4ae62b2335c8aa26d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.749894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35061af0b06b40b4ae62b2335c8aa26d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.750558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-328d950b-b4a0-45bf-bf20-e4043a573912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35061af0b06b40b4ae62b2335c8aa26d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:40.769563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1142/2314] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:40 2022] DELETE /identity/v3/users/35061af0b06b40b4ae62b2335c8aa26d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:41.113105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.114928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:41.131804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9878344-98b7-4819-b305-3dfab7c0f554 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.211734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.212520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.212871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.213215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] PATH_INFO: `/v3/projects/7d88e001da0f4fb08fbd3eb945ba259d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.214440 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d88e001da0f4fb08fbd3eb945ba259d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.216413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.300200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d88e001da0f4fb08fbd3eb945ba259d', 'request_id': 'req-95163e67-f5e7-4efd-ba5d-e32f56424aeb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:41.312080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d88e001da0f4fb08fbd3eb945ba259d', 'request_id': 'req-95163e67-f5e7-4efd-ba5d-e32f56424aeb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:41.321924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d88e001da0f4fb08fbd3eb945ba259d', 'request_id': 'req-95163e67-f5e7-4efd-ba5d-e32f56424aeb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:41.334267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] The token cache is being invalidate because project 7d88e001da0f4fb08fbd3eb945ba259d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:41.334267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:41.334898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-95163e67-f5e7-4efd-ba5d-e32f56424aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:41.337351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1173/2315] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:41 2022] DELETE /identity/v3/projects/7d88e001da0f4fb08fbd3eb945ba259d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:41.342237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.342626 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.342753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.387666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:41.388915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:41.477784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1143/2316] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:41.485544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.485882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.486241 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.523314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:41.524672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:41.534046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1174/2317] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:41.539541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.550871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79350931-849b-43ed-8aeb-4e103ee98632 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.556320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.556951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.557310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.557652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.558827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:41.559295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.562037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.583656 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1144/2318] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:41.584814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.596285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a727b-cb5e-4ebb-85ab-a3e1269a309a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.601518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.602701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.603305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.603900 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.604712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.606807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.657847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1175/2319] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:41 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:41.658949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.670153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e5e853-3e2b-48dc-87d3-b8f94bc426b5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.738887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.739629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.739987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.740331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.741054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.743324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.775664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1145/2320] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:41 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:41.779769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.790701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae78816-7a33-4041-abda-ceda20df6c85 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.795793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.796514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.796990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.797383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.798255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.800004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.803239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:41.820741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1176/2321] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:41.821621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.833107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb76783-4436-4c9c-93d7-d7eeae487ffe admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.838922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2fcf01-0f8b-439d-92d1-c4a81b868a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.839622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcf01-0f8b-439d-92d1-c4a81b868a15 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.839934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcf01-0f8b-439d-92d1-c4a81b868a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.840182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2fcf01-0f8b-439d-92d1-c4a81b868a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.840841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fcf01-0f8b-439d-92d1-c4a81b868a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.842516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2fcf01-0f8b-439d-92d1-c4a81b868a15 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.855133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1146/2322] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:41.859219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:41.871998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c9ee1-eae3-4db9-8ed9-9e18479ae5ed admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:41.877048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7515a79-d382-4c49-a558-e49f05d27399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:41.877734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7515a79-d382-4c49-a558-e49f05d27399 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.878026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7515a79-d382-4c49-a558-e49f05d27399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.878389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7515a79-d382-4c49-a558-e49f05d27399 admin admin] PATH_INFO: `/v3/projects/4727c5855b6f4e26bca7cec800014d73/users/4cc74474d4be4635bccc059aaaa83821/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.897783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7515a79-d382-4c49-a558-e49f05d27399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4727c5855b6f4e26bca7cec800014d73, user_id=4cc74474d4be4635bccc059aaaa83821, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:41.900947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7515a79-d382-4c49-a558-e49f05d27399 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:41.912978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.913275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.913564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.919639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1177/2323] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:41 2022] PUT /identity/v3/projects/4727c5855b6f4e26bca7cec800014d73/users/4cc74474d4be4635bccc059aaaa83821/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:41.930722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:41.931015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:41.931645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:41.938776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:41.940192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:41.969810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] MFA Rules not processed for user `4cc74474d4be4635bccc059aaaa83821`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:41.971039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:41.974871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:42.014229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1147/2324] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:42.029211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:42.030725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:42.050455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1178/2325] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:17:42.062725 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:42.064222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:42.128293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475987-6474-47ea-98bc-1a4a7d8f77f5 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:42.134833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:42.135453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:42.135748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:42.136004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:42.139452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83311e90-7294-4811-829d-c4f030c9b577 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:42.143796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb5f40d-5e87-4d2e-9744-ca6d6f637e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:42.144596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f40d-5e87-4d2e-9744-ca6d6f637e3e service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:42.145004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:42.145167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f40d-5e87-4d2e-9744-ca6d6f637e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:42.145519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb5f40d-5e87-4d2e-9744-ca6d6f637e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:42.146653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:42.154974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f40d-5e87-4d2e-9744-ca6d6f637e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:42.156478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb5f40d-5e87-4d2e-9744-ca6d6f637e3e service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:42.157340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1148/2326] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 30 00:17:42.166996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1179/2327] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:17:49.652764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:49.654522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:49.770157 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b962925-5509-4bbc-b4a2-4a09e1f5bc32 service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:49.776430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:49.777410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:49.777971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:49.778250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] PATH_INFO: `/v3/users/370378e5cdcd42abaea86ee40929c90f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:49.779778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=370378e5cdcd42abaea86ee40929c90f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:49.783325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:49.881734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '370378e5cdcd42abaea86ee40929c90f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:49.901484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '370378e5cdcd42abaea86ee40929c90f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:49.902319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '370378e5cdcd42abaea86ee40929c90f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:49.921529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '370378e5cdcd42abaea86ee40929c90f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:49.922225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '370378e5cdcd42abaea86ee40929c90f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:49.932726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:49.967192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1149/2328] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:49 2022] DELETE /identity/v3/users/370378e5cdcd42abaea86ee40929c90f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:49.969154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:49.969688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:49.969688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:50.011664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:50.013119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:50.154165 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1180/2329] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:50.192917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:50.195232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:50.357055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f287f8-2b13-4f2e-bc2e-bdac709f93c6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:50.367654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab832-1a92-4a2b-8ff8-3aeb66d01634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:50.369144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab832-1a92-4a2b-8ff8-3aeb66d01634 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:50.371197 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab832-1a92-4a2b-8ff8-3aeb66d01634 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:50.371577 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab832-1a92-4a2b-8ff8-3aeb66d01634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:50.390325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ab832-1a92-4a2b-8ff8-3aeb66d01634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:50.397502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0ab832-1a92-4a2b-8ff8-3aeb66d01634 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:50.429840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1150/2330] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:50.947023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:50.948483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:50.962691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e195e9-0d39-483c-8d0f-06f7a0d1a1bb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:50.967624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:50.968327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:50.968620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:50.968897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] PATH_INFO: `/v3/projects/5c3cbe22b72f4153b41bd83a63997bbb` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:50.970088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3cbe22b72f4153b41bd83a63997bbb)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:50.972468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:50.974726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:51.084191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3cbe22b72f4153b41bd83a63997bbb', 'request_id': 'req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:51.101856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3cbe22b72f4153b41bd83a63997bbb', 'request_id': 'req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:51.110636 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3cbe22b72f4153b41bd83a63997bbb', 'request_id': 'req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:51.132196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] The token cache is being invalidate because project 5c3cbe22b72f4153b41bd83a63997bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:51.132539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:51.133277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2741ece3-dcc1-4ffb-b3e3-83b2ec54e3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:51.138285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1181/2331] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:50 2022] DELETE /identity/v3/projects/5c3cbe22b72f4153b41bd83a63997bbb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:51.139985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.140482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.140664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.174309 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:51.177442 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:51.275835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1151/2332] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:51.283980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.284273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.284564 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.324381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:51.326413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:51.344531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1182/2333] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:51.349776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:51.363612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca926f-dd3a-489e-b020-2885e0633475 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:51.371292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:51.372102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.372807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.376683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.378586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:17:51.379752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:51.386796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:51.421751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1152/2334] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:17:51.421958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:51.443990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dada0a-53ed-4549-bafe-76cc8abf666a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:51.455650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:51.458059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.459641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.460122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.462623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:51.464797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:51.532557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1183/2335] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:17:51 2022] POST /identity/v3/projects => generated 397 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:51.536579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:51.551046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2ffc6a-479a-4d5d-bc64-8fc613c03979 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:51.668027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:51.668308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.668592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.668869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.669510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:51.671650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:51.706385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1153/2336] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:17:51 2022] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:17:51.707126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:51.722608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02043bd6-9e80-4c23-87e0-9449c4fc9f00 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:51.728151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:51.728985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.729484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.730242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.731055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:51.732888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:51.751952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1184/2337] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:17:51.753413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:51.763193 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:51.771671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f9f69-54a3-4701-a261-93eba99a73a3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:51.777749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f89673-fa5f-4ed9-8a19-47df18957abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:51.777927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89673-fa5f-4ed9-8a19-47df18957abd admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.779405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89673-fa5f-4ed9-8a19-47df18957abd admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.779405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f89673-fa5f-4ed9-8a19-47df18957abd admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.780423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89673-fa5f-4ed9-8a19-47df18957abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:51.782770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f89673-fa5f-4ed9-8a19-47df18957abd admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:51.795031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1154/2338] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:17:51.799468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:51.812873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d36244-a8d6-46a7-a8e8-81c1a7740f89 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:51.820647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:51.821593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.822234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.822873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] PATH_INFO: `/v3/projects/5007070439ce411593d1463f377d6f95/users/6ac153ce71d34273beefe60c243a5507/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.846632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5007070439ce411593d1463f377d6f95, user_id=6ac153ce71d34273beefe60c243a5507, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:51.850097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:51.878502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1185/2339] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:17:51 2022] PUT /identity/v3/projects/5007070439ce411593d1463f377d6f95/users/6ac153ce71d34273beefe60c243a5507/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:17:51.881980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:51.882378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:51.882746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:51.925664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] MFA Rules not processed for user `6ac153ce71d34273beefe60c243a5507`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:51.930700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:52.032241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1155/2340] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:52.045465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:52.047480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:52.137576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7e405-b441-44a4-895d-d5470a9ceb41 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:52.144358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1e7e-2f5d-4384-982c-2b794e531ce1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:52.145089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1e7e-2f5d-4384-982c-2b794e531ce1 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:52.145640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1e7e-2f5d-4384-982c-2b794e531ce1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:52.146063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1e7e-2f5d-4384-982c-2b794e531ce1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:52.156146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1e7e-2f5d-4384-982c-2b794e531ce1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:52.158270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1e7e-2f5d-4384-982c-2b794e531ce1 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:52.169367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1186/2341] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:52 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:55.064272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:55.066352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:55.149390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3376905d-8d50-4fd6-8a21-8ed68582184b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:55.154695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:55.155332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:55.155644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:55.155920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] PATH_INFO: `/v3/users/4cc74474d4be4635bccc059aaaa83821` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:55.157167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc74474d4be4635bccc059aaaa83821)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:55.159145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:55.250994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc74474d4be4635bccc059aaaa83821'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:55.258871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc74474d4be4635bccc059aaaa83821'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:55.260339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc74474d4be4635bccc059aaaa83821'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:55.272184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc74474d4be4635bccc059aaaa83821'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:55.272924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc74474d4be4635bccc059aaaa83821'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:55.299947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1156/2342] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:55 2022] DELETE /identity/v3/users/4cc74474d4be4635bccc059aaaa83821 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:55.304882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:55.305452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:55.305452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:55.326020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:55.327479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:55.358768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:55.442189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1187/2343] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:55.451737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:55.453858 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:55.465313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:55.538597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf737d-fed1-437b-b5e4-636e804c6051 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:55.542625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:55.543263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:55.543550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:55.543830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:55.558871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:55.561258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:55.577122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1157/2344] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:56.002436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:56.002436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:56.019536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481f0e7-cd3a-481a-b9a8-3711a14e2290 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:56.026762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:56.027410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:56.027867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:56.028009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] PATH_INFO: `/v3/projects/4727c5855b6f4e26bca7cec800014d73` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:56.029137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4727c5855b6f4e26bca7cec800014d73)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:56.031111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:56.081960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4727c5855b6f4e26bca7cec800014d73', 'request_id': 'req-175c2879-452e-4bee-88f0-b8d58665bf13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:56.089899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4727c5855b6f4e26bca7cec800014d73', 'request_id': 'req-175c2879-452e-4bee-88f0-b8d58665bf13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:56.096349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4727c5855b6f4e26bca7cec800014d73', 'request_id': 'req-175c2879-452e-4bee-88f0-b8d58665bf13'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:56.106566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] The token cache is being invalidate because project 4727c5855b6f4e26bca7cec800014d73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:56.106857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:56.107493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-175c2879-452e-4bee-88f0-b8d58665bf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:56.109068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1188/2345] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:55 2022] DELETE /identity/v3/projects/4727c5855b6f4e26bca7cec800014d73 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:57.638513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:57.639954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:57.653731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284907d-dd1b-4f08-a401-49061577179c service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:57.709957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:57.710567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:57.710847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:57.711119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] PATH_INFO: `/v3/users/6ac153ce71d34273beefe60c243a5507` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:57.712229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac153ce71d34273beefe60c243a5507)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:57.714198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:57.758964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac153ce71d34273beefe60c243a5507'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:57.766182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac153ce71d34273beefe60c243a5507'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:57.766843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac153ce71d34273beefe60c243a5507'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:57.774911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac153ce71d34273beefe60c243a5507'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:57.775789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac153ce71d34273beefe60c243a5507'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:57.793206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1158/2346] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:17:57 2022] DELETE /identity/v3/users/6ac153ce71d34273beefe60c243a5507 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:17:57.797676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:57.798168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:57.798281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:57.817070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:17:57.818296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:57.876185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1189/2347] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:17:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:17:57.885861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:57.887300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:57.916277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:57.947657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83a7660-a5b5-4313-ace9-8ba2c67d14bb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:57.951319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dce8ad3-4be2-4d30-a218-e67ac329a7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:57.951921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8ad3-4be2-4d30-a218-e67ac329a7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:57.952204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8ad3-4be2-4d30-a218-e67ac329a7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:57.952481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dce8ad3-4be2-4d30-a218-e67ac329a7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:57.962024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8ad3-4be2-4d30-a218-e67ac329a7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:57.963495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dce8ad3-4be2-4d30-a218-e67ac329a7a8 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:57.972851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1159/2348] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:17:58.245825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:17:58.247536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:17:58.262514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455100f-9eab-423c-88cd-23a39bf3c9e5 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:17:58.271357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:17:58.271825 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:17:58.272108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:17:58.272475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] PATH_INFO: `/v3/projects/5007070439ce411593d1463f377d6f95` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:17:58.273578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5007070439ce411593d1463f377d6f95)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:17:58.275990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:17:58.323963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:17:58.325873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5007070439ce411593d1463f377d6f95', 'request_id': 'req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:58.336637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5007070439ce411593d1463f377d6f95', 'request_id': 'req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:58.343403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5007070439ce411593d1463f377d6f95', 'request_id': 'req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:58.355047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] The token cache is being invalidate because project 5007070439ce411593d1463f377d6f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:17:58.355488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:58.356272 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5e4ff52b-ca1a-45a2-94e9-a10c9c8036f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:17:58.370047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1190/2349] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:17:58 2022] DELETE /identity/v3/projects/5007070439ce411593d1463f377d6f95 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:18:00.206728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79996b-85ab-4339-9d04-a85998cb1c97 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.207282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79996b-85ab-4339-9d04-a85998cb1c97 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.207494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79996b-85ab-4339-9d04-a85998cb1c97 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.208883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1160/2350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:18:00.214631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d08e1-6989-4269-895f-2eacf3a3f609 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.215099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d08e1-6989-4269-895f-2eacf3a3f609 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.215193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d08e1-6989-4269-895f-2eacf3a3f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.236521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-438d08e1-6989-4269-895f-2eacf3a3f609 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:00.237795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-438d08e1-6989-4269-895f-2eacf3a3f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.312760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1191/2351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:18:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:00.324608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79996b-85ab-4339-9d04-a85998cb1c97 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:00.326507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7d79996b-85ab-4339-9d04-a85998cb1c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.385643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79996b-85ab-4339-9d04-a85998cb1c97 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:00.389231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4982aad-165d-425b-b201-50ca6538c238 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:00.389889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982aad-165d-425b-b201-50ca6538c238 service glance] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.390188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982aad-165d-425b-b201-50ca6538c238 service glance] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.390448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4982aad-165d-425b-b201-50ca6538c238 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.400435 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4982aad-165d-425b-b201-50ca6538c238 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:00.402174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4982aad-165d-425b-b201-50ca6538c238 service glance] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:00.412923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.413152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.413412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1161/2352] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:00.413584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.434065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:00.436572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.486350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c30a5-13ea-4070-b5a1-35bbb2fc6161 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.486671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c30a5-13ea-4070-b5a1-35bbb2fc6161 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.486940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7c30a5-13ea-4070-b5a1-35bbb2fc6161 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.488322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1162/2353] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:18:00.493630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.493989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.494286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.511735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1192/2354] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:18:00.514382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:00.515606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.529020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:00.530420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.547601 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a6053-9949-4668-a4b0-48ff03303295 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:00.554245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc8601-f79a-49d0-87c9-702441907eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:00.554933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8601-f79a-49d0-87c9-702441907eb6 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.555212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8601-f79a-49d0-87c9-702441907eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.555485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc8601-f79a-49d0-87c9-702441907eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.564052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc8601-f79a-49d0-87c9-702441907eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:00.565618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc8601-f79a-49d0-87c9-702441907eb6 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:00.568153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1163/2355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:18:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:18:00.576375 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1193/2356] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:18:00.580469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:00.582499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.593379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d5df5-c14b-4862-8bbc-f32bcf59b7a7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:00.597285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13750f2-a5f4-4d1a-9bc5-3ba367f4b200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:00.598454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13750f2-a5f4-4d1a-9bc5-3ba367f4b200 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.599070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13750f2-a5f4-4d1a-9bc5-3ba367f4b200 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.599367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13750f2-a5f4-4d1a-9bc5-3ba367f4b200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.607080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13750f2-a5f4-4d1a-9bc5-3ba367f4b200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:00.608527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13750f2-a5f4-4d1a-9bc5-3ba367f4b200 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:00.618637 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1164/2357] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:00.721460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa88d7-455a-4875-af1d-a2210a433f7e None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.721874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa88d7-455a-4875-af1d-a2210a433f7e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.722247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa88d7-455a-4875-af1d-a2210a433f7e None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.724786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1194/2358] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:18:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:18:00.730425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d28b-e26d-4ba7-910e-72f7e0b14ca6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.730714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d28b-e26d-4ba7-910e-72f7e0b14ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.730988 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3d28b-e26d-4ba7-910e-72f7e0b14ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.751940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3af3d28b-e26d-4ba7-910e-72f7e0b14ca6 None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:00.753153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3af3d28b-e26d-4ba7-910e-72f7e0b14ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:00.762873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1165/2359] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:18:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:00.773910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa88d7-455a-4875-af1d-a2210a433f7e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:00.785052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa88d7-455a-4875-af1d-a2210a433f7e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:00.789213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:00.789833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:00.790119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:00.790394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:00.800395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:00.801905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:00.812494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1195/2360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:04.381981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147ed3a-251f-46a0-8a12-95b30d1eb6d1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:04.382544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147ed3a-251f-46a0-8a12-95b30d1eb6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:04.382544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147ed3a-251f-46a0-8a12-95b30d1eb6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:04.402676 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5147ed3a-251f-46a0-8a12-95b30d1eb6d1 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:04.403907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5147ed3a-251f-46a0-8a12-95b30d1eb6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:04.412592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1166/2361] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:18:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:04.448728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:04.450193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:04.465736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94911f8-5bf4-409d-afb7-5668b5505685 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:04.471881 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:04.472505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:04.472785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:04.473995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:04.482941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:04.484518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:04.494277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1196/2362] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:06.575346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfa44-dd19-496e-bca3-f3c2f8d25385 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:06.575802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfa44-dd19-496e-bca3-f3c2f8d25385 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:06.575907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973dfa44-dd19-496e-bca3-f3c2f8d25385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:06.594814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-973dfa44-dd19-496e-bca3-f3c2f8d25385 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:06.596003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-973dfa44-dd19-496e-bca3-f3c2f8d25385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:06.642704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:18:06.652959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1167/2363] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:18:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:18:06.666196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:06.667700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:06.701156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:18:06.743802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6118d-b30e-4548-8060-6554b4bc7029 service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:06.748841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a56818-9156-43bb-921d-61d98146006f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:06.749444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a56818-9156-43bb-921d-61d98146006f service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:06.749755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a56818-9156-43bb-921d-61d98146006f service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:06.750035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a56818-9156-43bb-921d-61d98146006f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:06.759010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a56818-9156-43bb-921d-61d98146006f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:06.760621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a56818-9156-43bb-921d-61d98146006f service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:06.768488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1197/2364] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:18:07.683283 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56ca9e-8c1c-40d3-b73d-a07d1a2e6aac None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:07.683823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56ca9e-8c1c-40d3-b73d-a07d1a2e6aac None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:07.683919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56ca9e-8c1c-40d3-b73d-a07d1a2e6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:07.703433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0e56ca9e-8c1c-40d3-b73d-a07d1a2e6aac None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:07.704625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0e56ca9e-8c1c-40d3-b73d-a07d1a2e6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:07.712603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1168/2365] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:07.731819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a56818-9156-43bb-921d-61d98146006f service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:07.751250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a56818-9156-43bb-921d-61d98146006f service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:07.758925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:07.759590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:07.759960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:07.760226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:07.771613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:07.773277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:07.784588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1198/2366] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:17.698099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:18:17.779499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=25 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:18:26.215206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ae5c-9b83-46e2-b218-e479b0d502da None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:26.215723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ae5c-9b83-46e2-b218-e479b0d502da None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:26.215723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0ae5c-9b83-46e2-b218-e479b0d502da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:26.235826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-97e0ae5c-9b83-46e2-b218-e479b0d502da None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:26.237065 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-97e0ae5c-9b83-46e2-b218-e479b0d502da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:26.245565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1169/2367] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:18:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:26.309511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:26.320692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfa5a-a40c-42bd-bc76-42daf0203270 service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:26.326502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:26.327092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:26.327369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:26.327641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:26.336487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:26.338069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:26.347296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1199/2368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:28.952925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:28.953437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:28.953522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:28.979276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:28.980522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:28.987598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1170/2369] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 00:18:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:29.011794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:29.023758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f6047-3fa5-4a4e-9f5d-e830ff4ef40c service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:29.029295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b47a0-cae1-44b6-861a-9cad8181ffb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:29.029922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b47a0-cae1-44b6-861a-9cad8181ffb7 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:29.030206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b47a0-cae1-44b6-861a-9cad8181ffb7 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:29.030476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b47a0-cae1-44b6-861a-9cad8181ffb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:29.039246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b47a0-cae1-44b6-861a-9cad8181ffb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:29.040807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b47a0-cae1-44b6-861a-9cad8181ffb7 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:29.048929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1200/2370] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:18:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:18:31.102413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:31.104339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:31.180514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947eb707-27f6-4e07-a7cc-76fcf78836c4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:31.187393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:31.187552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:31.187790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:31.188029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:31.189952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:31.204555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:31.206357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:31.221608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1171/2371] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:33.518033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e36b-31c4-43ee-ac0d-f57aa2e50a61 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:33.518936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e36b-31c4-43ee-ac0d-f57aa2e50a61 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:33.519223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e36b-31c4-43ee-ac0d-f57aa2e50a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:33.543827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-8251e36b-31c4-43ee-ac0d-f57aa2e50a61 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:33.545194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-8251e36b-31c4-43ee-ac0d-f57aa2e50a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:33.554051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1201/2372] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:33.574672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:33.588615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb1fb-1dfb-43c3-9a29-cdbf6f897483 service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:33.594317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:33.594999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:33.595589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:33.596068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:33.606011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:33.607659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:33.620341 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1172/2373] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:36.684023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07069133-d2b7-4a89-8b2a-3051a54c4380 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:36.684524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07069133-d2b7-4a89-8b2a-3051a54c4380 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:36.684623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07069133-d2b7-4a89-8b2a-3051a54c4380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:36.705458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-07069133-d2b7-4a89-8b2a-3051a54c4380 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:36.706734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-07069133-d2b7-4a89-8b2a-3051a54c4380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:36.715945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1202/2374] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:36.731498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:18:36.744068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba36258e-f579-45fc-9fcc-2e9709755eb8 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:18:36.752334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1b9f1c-72bb-4069-936d-c01d76fdb78a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:18:36.753070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9f1c-72bb-4069-936d-c01d76fdb78a service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:36.753457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9f1c-72bb-4069-936d-c01d76fdb78a service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:36.753863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1b9f1c-72bb-4069-936d-c01d76fdb78a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:36.765551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b9f1c-72bb-4069-936d-c01d76fdb78a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:18:36.767949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1b9f1c-72bb-4069-936d-c01d76fdb78a service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:18:36.780038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1173/2375] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:18:46.699828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=18 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:18:46.775159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=50 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:18:52.530619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053f3d8-f1cf-4159-a83a-fefca5b31978 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:52.531145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053f3d8-f1cf-4159-a83a-fefca5b31978 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:52.531246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053f3d8-f1cf-4159-a83a-fefca5b31978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:52.549835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-5053f3d8-f1cf-4159-a83a-fefca5b31978 None None] MFA Rules not processed for user `a7a214f6d0fa424e8c54e1934e0a6fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:52.551045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-5053f3d8-f1cf-4159-a83a-fefca5b31978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:52.606174 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1203/2376] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:18:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:18:55.325524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:18:55.325956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:18:55.326102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:18:55.346184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] MFA Rules not processed for user `384b994ced0847d9856458735987de42`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:18:55.347706 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:18:55.411989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1174/2377] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:18:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:19:02.599494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=25 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:19:05.404379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=25 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:19:11.396483 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9442bf-9f68-4ff7-91a2-79133942088d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:11.397115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9442bf-9f68-4ff7-91a2-79133942088d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:11.397115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9442bf-9f68-4ff7-91a2-79133942088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:11.417593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-7c9442bf-9f68-4ff7-91a2-79133942088d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:11.418966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7c9442bf-9f68-4ff7-91a2-79133942088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:11.427018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1204/2378] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:19:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:19:11.447017 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:19:11.460564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70be75-1e44-4950-888a-fe08604f57f3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:19:11.465942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:19:11.466538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:11.466816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:11.467104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:11.475929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:19:11.477509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:19:11.486748 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1175/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:19:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:19:14.607041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841024c-3e2c-4d2c-8a23-6059cdb39ebf None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:14.607568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841024c-3e2c-4d2c-8a23-6059cdb39ebf None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:14.607665 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841024c-3e2c-4d2c-8a23-6059cdb39ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:14.626687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-1841024c-3e2c-4d2c-8a23-6059cdb39ebf None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:14.627911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1841024c-3e2c-4d2c-8a23-6059cdb39ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:14.636662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1205/2380] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:19:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:19:14.652641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:19:14.664649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07718292-1401-42d6-b101-17cb2c839b56 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:19:14.671820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:19:14.672700 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:14.672990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:14.673265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:14.683000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:19:14.684595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:19:14.694685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1176/2381] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:19:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:19:18.724239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ac0b-26d2-430f-8d63-a7f13085fa08 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:18.725270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ac0b-26d2-430f-8d63-a7f13085fa08 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:18.725447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8ac0b-26d2-430f-8d63-a7f13085fa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:18.744928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-43d8ac0b-26d2-430f-8d63-a7f13085fa08 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:18.746203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-43d8ac0b-26d2-430f-8d63-a7f13085fa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:18.757541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1206/2382] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:19:18.794693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:19:18.805893 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a78603-42d9-471b-b802-09f18bd1525b service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:19:18.811314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:19:18.811898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:18.812238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:18.812515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:18.820645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:19:18.822279 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:19:18.831639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1177/2383] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:19:22.902318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96a38-2d38-42f5-8a53-89854b03b52e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:22.902873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96a38-2d38-42f5-8a53-89854b03b52e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:22.902873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b96a38-2d38-42f5-8a53-89854b03b52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:22.923904 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-56b96a38-2d38-42f5-8a53-89854b03b52e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:22.925102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-56b96a38-2d38-42f5-8a53-89854b03b52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:22.933674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1207/2384] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:19:22.949763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:19:22.961340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfb9a-bda5-425d-b88a-d59a1d285028 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:19:22.966797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c02ba55-e4b6-4093-a0e1-a00c411bd82e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:19:22.967410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02ba55-e4b6-4093-a0e1-a00c411bd82e service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:22.967686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02ba55-e4b6-4093-a0e1-a00c411bd82e service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:22.967958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c02ba55-e4b6-4093-a0e1-a00c411bd82e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:22.976203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02ba55-e4b6-4093-a0e1-a00c411bd82e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:19:22.977887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c02ba55-e4b6-4093-a0e1-a00c411bd82e service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:19:22.987291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1178/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:19:25.506461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef920e-f15a-4fa2-a74e-5709253091b1 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:25.506971 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef920e-f15a-4fa2-a74e-5709253091b1 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:25.507114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efef920e-f15a-4fa2-a74e-5709253091b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:25.526438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-efef920e-f15a-4fa2-a74e-5709253091b1 None None] MFA Rules not processed for user `66526665148e4f1792868ce8d0c449f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:25.527677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-efef920e-f15a-4fa2-a74e-5709253091b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:25.585988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1208/2386] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:19:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:19:25.616465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:25.616993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:25.617097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:25.635899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] MFA Rules not processed for user `ea5524cca92f42c3841e74995edee832`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:25.637270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:25.694811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1179/2387] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:19:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:19:28.137121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:28.137619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:28.137746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:28.161550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:19:28.162897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:19:28.171768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1209/2388] 10.222.0.49 () {58 vars in 1016 bytes} [Tue Aug 30 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:19:28.196556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:19:28.210113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e34da-e85b-44c4-8493-c408d526c55a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:19:28.215451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:19:28.216043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:19:28.216324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:19:28.216596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:19:28.225457 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:19:28.227074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:19:28.236532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1180/2389] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:19:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:19:38.153871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=40 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:19:38.232318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=55 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:01.840674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:01.842691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:01.855680 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2597557-5d74-4275-aa9c-a2d402657f46 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:01.860325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:01.860986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:01.861455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:01.861770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] PATH_INFO: `/v3/users/384b994ced0847d9856458735987de42` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:01.862944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384b994ced0847d9856458735987de42)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:01.864852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:01.923302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384b994ced0847d9856458735987de42'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:01.930635 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384b994ced0847d9856458735987de42'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:01.931371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384b994ced0847d9856458735987de42'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:01.943524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384b994ced0847d9856458735987de42'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:01.951344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-7f215d86-4fc2-4402-9073-e465b20304d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384b994ced0847d9856458735987de42'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:01.958951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1210/2390] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:20:01 2022] DELETE /identity/v3/users/384b994ced0847d9856458735987de42 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:02.178623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:02.199076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f337606-5e47-4f03-8092-e876d9696215 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:02.283277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:02.283924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:02.284216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:02.284481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] PATH_INFO: `/v3/projects/6fba87e20fcc484789037ad39a8728c2` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:02.285638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fba87e20fcc484789037ad39a8728c2)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:02.287722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:02.342198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fba87e20fcc484789037ad39a8728c2', 'request_id': 'req-236a0853-4491-4b7f-b9da-f9bda39f4b7d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:02.374491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fba87e20fcc484789037ad39a8728c2', 'request_id': 'req-236a0853-4491-4b7f-b9da-f9bda39f4b7d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:02.383613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fba87e20fcc484789037ad39a8728c2', 'request_id': 'req-236a0853-4491-4b7f-b9da-f9bda39f4b7d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:02.396714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] The token cache is being invalidate because project 6fba87e20fcc484789037ad39a8728c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:20:02.397014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:02.397692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-236a0853-4491-4b7f-b9da-f9bda39f4b7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:02.401787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1181/2391] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:20:02 2022] DELETE /identity/v3/projects/6fba87e20fcc484789037ad39a8728c2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:03.521004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:03.521470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:03.521565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:03.542281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] MFA Rules not processed for user `d8e6d4ffefda4a2ea7ac2ab7b61158e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:03.543385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:03.602824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1211/2392] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:12.393238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:13.058933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:13.059282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:13.059597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:13.079395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] MFA Rules not processed for user `a7a214f6d0fa424e8c54e1934e0a6fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:13.080610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:13.135845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1182/2393] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:20:13.595078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:23.128510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=25 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:36.711922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:36.713358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:36.771417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d0cfe-f50a-40ab-ae07-5c5d5b5f5837 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:36.775009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:36.775613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:36.775895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:36.776168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:36.778713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:36.836160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:36.837582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:36.847277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1212/2394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:41.167344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:41.169181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:41.228185 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d29ef-d4d0-44c2-b031-9fe96eb691d4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:41.231895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:41.232496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:41.232777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:41.233049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:41.234810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:41.303834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:41.305266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:41.316080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1183/2395] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:20:42.431446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:42.432864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:42.445605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5003e-c667-45ee-b7ad-1b52a27e956e service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:42.449739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:42.450338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:42.450623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:42.450899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:42.452654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:42.520341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:42.521808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:42.532586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1213/2396] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:45.818306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:45.818306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:45.829219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7db55-55cb-43f6-9ba4-49afa1d5b8e0 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:45.834409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:45.835123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:45.835410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:45.835688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] PATH_INFO: `/v3/users/ea5524cca92f42c3841e74995edee832` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:45.836831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5524cca92f42c3841e74995edee832)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:45.838854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:45.885473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5524cca92f42c3841e74995edee832'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:45.892429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5524cca92f42c3841e74995edee832'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:45.893106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5524cca92f42c3841e74995edee832'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:45.900276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5524cca92f42c3841e74995edee832'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:45.901035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-52a7b554-e83e-482c-9c97-31055d74523d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5524cca92f42c3841e74995edee832'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:45.920804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1184/2397] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:20:45 2022] DELETE /identity/v3/users/ea5524cca92f42c3841e74995edee832 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:46.094291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.104024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58b15b4-f8b9-4f35-aac2-4e476be2d6d8 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.152471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:46.164745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.165373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.165650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.165952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] PATH_INFO: `/v3/projects/88043ef8a7834208a50a12573d5ec5b5` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.167097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88043ef8a7834208a50a12573d5ec5b5)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.170004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.215703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88043ef8a7834208a50a12573d5ec5b5', 'request_id': 'req-4daac153-b310-4fdb-be7f-8f9fce87d457'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:46.222761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88043ef8a7834208a50a12573d5ec5b5', 'request_id': 'req-4daac153-b310-4fdb-be7f-8f9fce87d457'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:46.228831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88043ef8a7834208a50a12573d5ec5b5', 'request_id': 'req-4daac153-b310-4fdb-be7f-8f9fce87d457'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:46.240979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] The token cache is being invalidate because project 88043ef8a7834208a50a12573d5ec5b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:20:46.241354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:46.241945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4daac153-b310-4fdb-be7f-8f9fce87d457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:46.243447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1214/2398] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:20:46 2022] DELETE /identity/v3/projects/88043ef8a7834208a50a12573d5ec5b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:20:46.254325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.254805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.255156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.275289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:46.276576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:46.286392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:46.340856 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1185/2399] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:20:46.348827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcddfba-920f-4ade-9884-438463a68145 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.349224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcddfba-920f-4ade-9884-438463a68145 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.349577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcddfba-920f-4ade-9884-438463a68145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.370121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-afcddfba-920f-4ade-9884-438463a68145 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:46.374369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-afcddfba-920f-4ade-9884-438463a68145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:46.383234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1215/2400] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:46.390587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.401230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca14245-3ceb-4f1d-bd51-6f14d369c76d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.406978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.407760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.408111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.408458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.409436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:20:46.409849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.411538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.426438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1186/2401] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:20:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:20:46.431212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcddfba-920f-4ade-9884-438463a68145 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.441646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcddfba-920f-4ade-9884-438463a68145 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.446745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.447426 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.447837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.448188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.449513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.451719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.484225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1216/2402] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:20:46 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:20:46.485368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.496111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77efa9e-f230-458b-86cf-1cfa59b7201a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.553851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.554521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.554806 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.555083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.555729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.557727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.579372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1187/2403] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:20:46 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:20:46.583387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.595008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8279037-918e-45d0-b787-abe24ff04936 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.599582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.600163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.600442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.600712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.601349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.603045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.613054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1217/2404] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:46.617092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.627298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10b3df-a149-4b45-a01a-526dccbbebb1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.631996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae430ddc-7366-47fe-94de-0418237e1d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.632592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430ddc-7366-47fe-94de-0418237e1d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.632877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430ddc-7366-47fe-94de-0418237e1d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.633181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae430ddc-7366-47fe-94de-0418237e1d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.633873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae430ddc-7366-47fe-94de-0418237e1d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.635473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae430ddc-7366-47fe-94de-0418237e1d1a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.646604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1188/2405] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:46.650748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.661335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726637d1-1153-4cdd-a1be-3dedb52c84d0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.666249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.666899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.667188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.667610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] PATH_INFO: `/v3/projects/a83bda0f76654b9fa50bff36bd9f62cf/users/056b3f30f55443c694f41bf1902ccd6e/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.681966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83bda0f76654b9fa50bff36bd9f62cf, user_id=056b3f30f55443c694f41bf1902ccd6e, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.684779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.697588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1218/2406] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:46 2022] PUT /identity/v3/projects/a83bda0f76654b9fa50bff36bd9f62cf/users/056b3f30f55443c694f41bf1902ccd6e/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:46.703390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.703683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.703962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.723367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:46.724658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:46.782753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1189/2407] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:46.792729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:46.794615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:46.851396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79752310-77e9-441f-9945-7dbcf3f712b9 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:46.855376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531318f6-adfe-4d4b-bd21-5cbf6997529c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:46.855704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531318f6-adfe-4d4b-bd21-5cbf6997529c service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:46.855982 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531318f6-adfe-4d4b-bd21-5cbf6997529c service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:46.856250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531318f6-adfe-4d4b-bd21-5cbf6997529c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:46.865118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531318f6-adfe-4d4b-bd21-5cbf6997529c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:46.866551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531318f6-adfe-4d4b-bd21-5cbf6997529c service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:46.876485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1219/2408] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:47.473255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:47.475023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:47.495041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3da242-fc02-46ec-862b-52338990d316 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:47.500896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:47.501630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:47.502158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:47.502701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:47.505588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:47.524421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:47.524947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:47.525987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:47.533578 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:47.576867 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] MFA Rules not processed for user `056b3f30f55443c694f41bf1902ccd6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:47.578863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:47.591921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:47.602579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:47.604138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:47.617255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1190/2409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:47.663373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1220/2410] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:47.668956 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:47.679630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925f5d-ff9f-4c31-a377-cbc1d6ceca87 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:47.684541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:47.685289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:47.685675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:47.686082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:47.687000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:47.688881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:47.723528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1191/2411] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:20:47 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:20:47.727846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:47.741589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064599a-c1e6-48eb-b58c-3fe5ecac430c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:47.809109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:47.809730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:47.810022 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:47.810296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:47.810924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:47.812827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:47.834137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1221/2412] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:20:47 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:20:47.838301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:47.849722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537bb53-1e36-48b9-90bd-90c4568211d8 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:47.854857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:47.855474 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:47.855751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:47.856028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:47.856681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:47.858504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:47.870584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1192/2413] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:47.875027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:47.885478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985b6ec-4a7b-4621-8a08-79f4a86b013c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:47.890923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:47.891573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:47.891855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:47.892128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] PATH_INFO: `/v3/projects/faf7f0f9c42144a7acc4d253bdd04c83/users/0787aa6c123e41e9a3dc9db5e2077a2b/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:47.908183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf7f0f9c42144a7acc4d253bdd04c83, user_id=0787aa6c123e41e9a3dc9db5e2077a2b, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:47.911129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:47.927456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1222/2414] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:47 2022] PUT /identity/v3/projects/faf7f0f9c42144a7acc4d253bdd04c83/users/0787aa6c123e41e9a3dc9db5e2077a2b/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:47.931471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:47.942372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9bdf8-bf50-4150-9cda-64f6a7c15ccb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:48.002832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebad8e-66cf-4c33-9857-237d5af9aadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:48.003437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebad8e-66cf-4c33-9857-237d5af9aadc admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:48.003720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebad8e-66cf-4c33-9857-237d5af9aadc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:48.004004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebad8e-66cf-4c33-9857-237d5af9aadc admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:48.004645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebad8e-66cf-4c33-9857-237d5af9aadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:48.006276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaebad8e-66cf-4c33-9857-237d5af9aadc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:48.016771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1193/2415] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:48.021127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:48.031990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b0506-dd49-48d2-8fb1-fd4f2bdea576 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:48.036972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:48.037619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:48.037931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:48.038232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] PATH_INFO: `/v3/projects/faf7f0f9c42144a7acc4d253bdd04c83/users/0787aa6c123e41e9a3dc9db5e2077a2b/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:48.040120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf7f0f9c42144a7acc4d253bdd04c83, user_id=0787aa6c123e41e9a3dc9db5e2077a2b, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:48.042837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:48.052919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1223/2416] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:48 2022] PUT /identity/v3/projects/faf7f0f9c42144a7acc4d253bdd04c83/users/0787aa6c123e41e9a3dc9db5e2077a2b/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:48.676690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:48.677204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:48.677333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:48.707508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] MFA Rules not processed for user `0787aa6c123e41e9a3dc9db5e2077a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:48.708774 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:48.776511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:48.788710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1194/2417] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:48 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:49.884290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:49.952090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d85b59-b880-4562-960a-5bd5f6ecd871 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:49.956593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:49.957215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:49.957499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:49.957800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] PATH_INFO: `/v3/users/056b3f30f55443c694f41bf1902ccd6e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:49.958907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] RBAC: Authorizing `identity:delete_user(user_id=056b3f30f55443c694f41bf1902ccd6e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:49.960836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:49.962364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:50.008653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056b3f30f55443c694f41bf1902ccd6e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.015748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056b3f30f55443c694f41bf1902ccd6e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.016456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056b3f30f55443c694f41bf1902ccd6e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.029283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056b3f30f55443c694f41bf1902ccd6e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.037302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056b3f30f55443c694f41bf1902ccd6e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.044190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1224/2418] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:20:49 2022] DELETE /identity/v3/users/056b3f30f55443c694f41bf1902ccd6e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:50.296129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:50.316201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d47879-56aa-4091-862e-b0b26619c3ae None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:50.375230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:50.375871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:50.376155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:50.376441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] PATH_INFO: `/v3/projects/a83bda0f76654b9fa50bff36bd9f62cf` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:50.377565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83bda0f76654b9fa50bff36bd9f62cf)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:50.379531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:50.425551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83bda0f76654b9fa50bff36bd9f62cf', 'request_id': 'req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.431819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83bda0f76654b9fa50bff36bd9f62cf', 'request_id': 'req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.439032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83bda0f76654b9fa50bff36bd9f62cf', 'request_id': 'req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.449821 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] The token cache is being invalidate because project a83bda0f76654b9fa50bff36bd9f62cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:20:50.450113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.450760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.452246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1195/2419] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:20:50 2022] DELETE /identity/v3/projects/a83bda0f76654b9fa50bff36bd9f62cf => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:50.456940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:50.459261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:50.479341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91657e30-3033-48e7-bead-8098fba6835a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:50.536318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:50.536944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:50.537222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:50.537492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] PATH_INFO: `/v3/users/0787aa6c123e41e9a3dc9db5e2077a2b` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:50.538697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0787aa6c123e41e9a3dc9db5e2077a2b)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:50.540544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:50.585416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0787aa6c123e41e9a3dc9db5e2077a2b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.592844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0787aa6c123e41e9a3dc9db5e2077a2b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.593508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0787aa6c123e41e9a3dc9db5e2077a2b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.606651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0787aa6c123e41e9a3dc9db5e2077a2b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.614958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d01afed0-e1bd-4fba-a527-a7d2a6914c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0787aa6c123e41e9a3dc9db5e2077a2b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.616512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:50.621907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1225/2420] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:20:50 2022] DELETE /identity/v3/users/0787aa6c123e41e9a3dc9db5e2077a2b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:50.795918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:50.797363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:50.810482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce28b1-448d-4e4d-a5f1-c113a3926e0d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:50.870369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:50.871312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:50.871634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:50.871896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] PATH_INFO: `/v3/projects/faf7f0f9c42144a7acc4d253bdd04c83` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:50.873025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf7f0f9c42144a7acc4d253bdd04c83)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:50.874978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:50.905950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:50.924364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf7f0f9c42144a7acc4d253bdd04c83', 'request_id': 'req-6eb7bde0-5f24-4421-812d-9edea4ef52b0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.931432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf7f0f9c42144a7acc4d253bdd04c83', 'request_id': 'req-6eb7bde0-5f24-4421-812d-9edea4ef52b0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.937981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf7f0f9c42144a7acc4d253bdd04c83', 'request_id': 'req-6eb7bde0-5f24-4421-812d-9edea4ef52b0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.948382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] The token cache is being invalidate because project faf7f0f9c42144a7acc4d253bdd04c83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:20:50.948677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.950155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6eb7bde0-5f24-4421-812d-9edea4ef52b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:50.951666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1196/2421] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:20:50 2022] DELETE /identity/v3/projects/faf7f0f9c42144a7acc4d253bdd04c83 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:50.956557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:50.957046 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:50.957140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:50.978762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:50.980003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:51.038351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1226/2422] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:51.046799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.047009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.047289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.067853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:51.069062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:51.077284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1197/2423] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:51.081626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.091604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e55f0f-9006-455d-b569-8dd5847df41d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.096128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.096723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.097010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.097300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.097984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:20:51.098290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.099886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.112230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1227/2424] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:20:51.116919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.126741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d4eca-eb4d-46a0-958e-18f2100ca18a None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.131362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.131951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.132231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.132504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.133142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.135066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.165519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1198/2425] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:20:51.166765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.177017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0d866-e205-4191-9d1b-8f6d10835dab admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.232907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.233508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.233818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.234094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.234715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.236631 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.256534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1228/2426] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:20:51.262809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.273275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89e45e-441b-41d0-a1d2-effb04f93e45 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.278742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.279369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.279682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.279955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.280600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.282234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.294323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1199/2427] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:51.298466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.309205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3e935-2478-40e2-8741-844125eadf9d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.313996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6cf69-4dce-4e4e-905f-48546a9b9d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.314606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cf69-4dce-4e4e-905f-48546a9b9d7a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.314890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cf69-4dce-4e4e-905f-48546a9b9d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.315190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6cf69-4dce-4e4e-905f-48546a9b9d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.315844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cf69-4dce-4e4e-905f-48546a9b9d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.317448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6cf69-4dce-4e4e-905f-48546a9b9d7a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.329535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1229/2428] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:51.333831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.345635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfa3258-cef1-405a-9689-1420476be1f3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.350535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.351194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.351476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.351754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] PATH_INFO: `/v3/projects/6000b0223ae24e8f92339c4c3ef88a37/users/312063c32108421f908bc9483b5411c1/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.367986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6000b0223ae24e8f92339c4c3ef88a37, user_id=312063c32108421f908bc9483b5411c1, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.370761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.387507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1200/2429] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:51 2022] PUT /identity/v3/projects/6000b0223ae24e8f92339c4c3ef88a37/users/312063c32108421f908bc9483b5411c1/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:51.397534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.398027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.398371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.430420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] MFA Rules not processed for user `312063c32108421f908bc9483b5411c1`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:51.431817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:51.493445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:51.504672 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1230/2430] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:20:51.509222 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.570808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371fed52-6bc5-43ca-9638-7d52416a1cff admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.576051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.576646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.576927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.577199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.577867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.579772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.606861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1201/2431] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:20:51.610989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.622697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68a62c-2286-426c-9d17-af53a76479a9 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.678827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.679430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.679712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.679986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.680623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.682554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.705131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1231/2432] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:20:51.712704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.729083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67546fc-dd7c-4e86-aca2-5bd8b932b0ed admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.734081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.734673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.734952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.735224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.735864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.737465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.748899 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1202/2433] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:51.752914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.763762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac14f5-c65e-41fb-b789-24df8d9866bc admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.768361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13274b5a-60e4-4392-ab6f-87667dc7599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.768948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274b5a-60e4-4392-ab6f-87667dc7599b admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.769225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274b5a-60e4-4392-ab6f-87667dc7599b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.769492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13274b5a-60e4-4392-ab6f-87667dc7599b admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.770178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13274b5a-60e4-4392-ab6f-87667dc7599b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.771763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13274b5a-60e4-4392-ab6f-87667dc7599b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.782371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1232/2434] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:20:51.786615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:51.796336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714826f-8f5f-411e-aaa8-4a24f43cb10e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:51.800868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:51.801498 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.801811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.802086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] PATH_INFO: `/v3/projects/442044a3e9ad46578b53279ffe9b1bd1/users/8b5faaac5dec4155a89c84f0da8b8198/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.816090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=442044a3e9ad46578b53279ffe9b1bd1, user_id=8b5faaac5dec4155a89c84f0da8b8198, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:51.818764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:51.828381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:51.833592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1203/2435] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:51 2022] PUT /identity/v3/projects/442044a3e9ad46578b53279ffe9b1bd1/users/8b5faaac5dec4155a89c84f0da8b8198/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:51.846549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:51.846838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:51.847133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:51.874619 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] MFA Rules not processed for user `8b5faaac5dec4155a89c84f0da8b8198`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:51.875830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:51.943033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1233/2436] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:51.952641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.015040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118667e-544d-4fee-b701-99354337d5a4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.020103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.020709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.020989 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.021287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.021961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.023949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.051287 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1204/2437] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:20:51 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:20:52.055514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.067051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5c11-0de0-4e51-aa88-a9c2125f834f None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.125273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.125913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.126197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.126570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.127211 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.129237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.139407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:52.151649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1234/2438] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:20:52 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:20:52.155794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.166451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482507-3e54-4a67-80a5-9b204c26e549 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.171330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.171923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.172204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.172480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.173154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.175113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.186433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1205/2439] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:20:52.190454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.200802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ea1ee-6910-4bdb-ace8-8edea6f8b45c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.205335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.206008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.206290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.206565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] PATH_INFO: `/v3/projects/3d4eb4102fc54ed8b1086887021af446/users/f05015ef21bc46aaa60d84f9ccb02240/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.220955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4eb4102fc54ed8b1086887021af446, user_id=f05015ef21bc46aaa60d84f9ccb02240, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.223660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.236776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1235/2440] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:52 2022] PUT /identity/v3/projects/3d4eb4102fc54ed8b1086887021af446/users/f05015ef21bc46aaa60d84f9ccb02240/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:52.240876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.251996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec65dd9-b16c-4518-b5f8-5536f9818095 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.309307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c36a06-8e51-4d59-aaa6-2807a6b44e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.309934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c36a06-8e51-4d59-aaa6-2807a6b44e78 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.310219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c36a06-8e51-4d59-aaa6-2807a6b44e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.310489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c36a06-8e51-4d59-aaa6-2807a6b44e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.311133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c36a06-8e51-4d59-aaa6-2807a6b44e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.312718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c36a06-8e51-4d59-aaa6-2807a6b44e78 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.322694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1206/2441] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:20:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:20:52.327614 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.337787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77644c0b-6e2d-476a-85dd-a55f13221666 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.342489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.343135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.343419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.343698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] PATH_INFO: `/v3/projects/3d4eb4102fc54ed8b1086887021af446/users/f05015ef21bc46aaa60d84f9ccb02240/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.345630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d4eb4102fc54ed8b1086887021af446, user_id=f05015ef21bc46aaa60d84f9ccb02240, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.348408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.359100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1236/2442] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:20:52 2022] PUT /identity/v3/projects/3d4eb4102fc54ed8b1086887021af446/users/f05015ef21bc46aaa60d84f9ccb02240/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:20:52.369159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.369661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.369826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.399844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] MFA Rules not processed for user `f05015ef21bc46aaa60d84f9ccb02240`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:52.401047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:52.460461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:52.472591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1207/2443] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:52.489787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:52.491542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:52.551785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf32b788-64d4-4a65-9751-e03b3cf3f82d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:52.555570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:52.556182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:52.556469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:52.556747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:52.567051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:52.568493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:52.578823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1237/2444] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:53.079527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:53.080922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:53.093148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d2a04-6b0c-4a77-bf60-ab52ad92b4d2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:53.096718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03978856-963e-4225-8447-7212ff228412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:53.097311 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978856-963e-4225-8447-7212ff228412 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:53.097592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978856-963e-4225-8447-7212ff228412 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:53.097888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03978856-963e-4225-8447-7212ff228412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:53.154374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03978856-963e-4225-8447-7212ff228412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:53.155849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03978856-963e-4225-8447-7212ff228412 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:53.164928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1208/2445] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:57.189072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:57.197961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b13dd29-8337-4739-8096-e7d30ef02460 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:57.201974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:57.202577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:57.202861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:57.203135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:57.264393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:57.266010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:57.277839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1238/2446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:20:58.294740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56091381-49b8-4652-94f9-906841b65f9c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:58.295201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56091381-49b8-4652-94f9-906841b65f9c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:58.295356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56091381-49b8-4652-94f9-906841b65f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:58.314819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-56091381-49b8-4652-94f9-906841b65f9c None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:58.316027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-56091381-49b8-4652-94f9-906841b65f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:58.373465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1209/2447] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:20:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:58.433220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:58.435435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:58.493002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:58.510387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c1da6f-0904-46ff-8b88-09447c26d132 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:58.516550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45aa20-7168-4d08-9cd8-7d193b5c9877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:58.517173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45aa20-7168-4d08-9cd8-7d193b5c9877 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:58.517454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45aa20-7168-4d08-9cd8-7d193b5c9877 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:58.517755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45aa20-7168-4d08-9cd8-7d193b5c9877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:58.526451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45aa20-7168-4d08-9cd8-7d193b5c9877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:58.528855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45aa20-7168-4d08-9cd8-7d193b5c9877 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:58.537697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1239/2448] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:20:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:20:59.487505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56091381-49b8-4652-94f9-906841b65f9c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:59.563716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56091381-49b8-4652-94f9-906841b65f9c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:59.571873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:59.572507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:59.572965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:59.573273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] PATH_INFO: `/v3/users/312063c32108421f908bc9483b5411c1` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:59.575082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] RBAC: Authorizing `identity:delete_user(user_id=312063c32108421f908bc9483b5411c1)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:59.580026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:59.646822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:20:59.653948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '312063c32108421f908bc9483b5411c1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:59.665853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '312063c32108421f908bc9483b5411c1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:59.666720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '312063c32108421f908bc9483b5411c1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:59.676945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '312063c32108421f908bc9483b5411c1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:59.677788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '312063c32108421f908bc9483b5411c1'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:20:59.698386 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1210/2449] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:20:59 2022] DELETE /identity/v3/users/312063c32108421f908bc9483b5411c1 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:20:59.704847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:59.706422 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:59.706955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:59.732785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:20:59.734321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:59.828739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1240/2450] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:20:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:20:59.839431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:20:59.841387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:20:59.904522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb911b6-c2b0-4f54-bf5c-87080deca27b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:20:59.910391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:20:59.911278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:20:59.913846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:20:59.914433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:20:59.928055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:20:59.929666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:20:59.942584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1211/2451] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:00.267139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:00.268710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:00.288126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f64338-2616-43f2-8f01-93d47e789f3e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:00.293906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:00.294575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:00.295008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:00.295288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] PATH_INFO: `/v3/projects/6000b0223ae24e8f92339c4c3ef88a37` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:00.296466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6000b0223ae24e8f92339c4c3ef88a37)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:00.302297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:00.368894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6000b0223ae24e8f92339c4c3ef88a37', 'request_id': 'req-028cdddd-2718-43e5-99c2-b35548482319'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.384057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6000b0223ae24e8f92339c4c3ef88a37', 'request_id': 'req-028cdddd-2718-43e5-99c2-b35548482319'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.392456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6000b0223ae24e8f92339c4c3ef88a37', 'request_id': 'req-028cdddd-2718-43e5-99c2-b35548482319'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.407615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] The token cache is being invalidate because project 6000b0223ae24e8f92339c4c3ef88a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:00.407916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.408587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.411068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1241/2452] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:00 2022] DELETE /identity/v3/projects/6000b0223ae24e8f92339c4c3ef88a37 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:00.414523 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:00.426733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e40d5-4901-4e04-9bcb-01d44ef83942 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:00.503098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:00.504429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:00.504429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:00.504429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] PATH_INFO: `/v3/users/8b5faaac5dec4155a89c84f0da8b8198` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:00.505900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5faaac5dec4155a89c84f0da8b8198)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:00.508034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:00.581491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5faaac5dec4155a89c84f0da8b8198'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.591143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5faaac5dec4155a89c84f0da8b8198'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.591868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5faaac5dec4155a89c84f0da8b8198'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.602288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5faaac5dec4155a89c84f0da8b8198'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.603171 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5faaac5dec4155a89c84f0da8b8198'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:00.604749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:00.633005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1212/2453] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:00 2022] DELETE /identity/v3/users/8b5faaac5dec4155a89c84f0da8b8198 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:00.974119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:00.975824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:00.997242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cdddd-2718-43e5-99c2-b35548482319 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:01.091877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:01.092531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:01.092816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:01.093092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] PATH_INFO: `/v3/projects/442044a3e9ad46578b53279ffe9b1bd1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:01.094303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=442044a3e9ad46578b53279ffe9b1bd1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:01.096233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:01.110889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:01.155445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '442044a3e9ad46578b53279ffe9b1bd1', 'request_id': 'req-c82ec879-bee1-40fa-983f-4c49804704f5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.164715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '442044a3e9ad46578b53279ffe9b1bd1', 'request_id': 'req-c82ec879-bee1-40fa-983f-4c49804704f5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.173142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '442044a3e9ad46578b53279ffe9b1bd1', 'request_id': 'req-c82ec879-bee1-40fa-983f-4c49804704f5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.185688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] The token cache is being invalidate because project 442044a3e9ad46578b53279ffe9b1bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:01.186008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.186679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.188196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1242/2454] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:00 2022] DELETE /identity/v3/projects/442044a3e9ad46578b53279ffe9b1bd1 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:01.192438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:01.193926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:01.207891 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf52cc-9eb5-4132-ae99-bd1c6014eb3d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:01.277699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:01.278390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:01.278678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:01.278960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] PATH_INFO: `/v3/users/f05015ef21bc46aaa60d84f9ccb02240` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:01.280331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05015ef21bc46aaa60d84f9ccb02240)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:01.282360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:01.347354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05015ef21bc46aaa60d84f9ccb02240'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.354898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05015ef21bc46aaa60d84f9ccb02240'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.356192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05015ef21bc46aaa60d84f9ccb02240'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.364186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05015ef21bc46aaa60d84f9ccb02240'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.364887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-67631a84-42d7-4a43-be78-7746f5c9f67a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05015ef21bc46aaa60d84f9ccb02240'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.386768 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1213/2455] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:01 2022] DELETE /identity/v3/users/f05015ef21bc46aaa60d84f9ccb02240 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:01.736267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:01.737746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:01.752916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ec879-bee1-40fa-983f-4c49804704f5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:01.825347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:01.826114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:01.826469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:01.826818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] PATH_INFO: `/v3/projects/3d4eb4102fc54ed8b1086887021af446` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:01.828045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d4eb4102fc54ed8b1086887021af446)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:01.830067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:01.884445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d4eb4102fc54ed8b1086887021af446', 'request_id': 'req-2655770d-2f03-4b4d-bc9e-ba38f105776b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.895146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d4eb4102fc54ed8b1086887021af446', 'request_id': 'req-2655770d-2f03-4b4d-bc9e-ba38f105776b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.902661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d4eb4102fc54ed8b1086887021af446', 'request_id': 'req-2655770d-2f03-4b4d-bc9e-ba38f105776b'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.919284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] The token cache is being invalidate because project 3d4eb4102fc54ed8b1086887021af446 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:01.919634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.920384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2655770d-2f03-4b4d-bc9e-ba38f105776b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:01.926515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1243/2456] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:01 2022] DELETE /identity/v3/projects/3d4eb4102fc54ed8b1086887021af446 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:01.928229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:01.928679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:01.928851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:01.953291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:01.954580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:02.017110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:02.027247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1214/2457] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:02.039323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.039879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.039879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.062496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:02.063736 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:02.072269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1244/2458] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:02.076955 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.087600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9b98c1-8497-4da1-a817-9a0868c4a37e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.095575 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.096528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.098770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.099281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.100315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:02.100831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.102750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.122299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1215/2459] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:21:02.126465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.137116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1d6af-3ea3-42fe-887e-db235f5d8f0a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.142998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.143693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.144048 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.144397 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.145493 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.148681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.175234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:02.189369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1245/2460] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:02 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:02.191066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.204224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8d77d-79ac-44ae-8bb8-cc58c376fa5b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.303648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.304281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.304560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.304952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.305564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.307591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.332497 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1216/2461] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:02 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:02.336857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.348862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c907e-61c1-4ab8-a80d-991f36e4bed1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.353673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.354389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.354681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.354959 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.355702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.358161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.371532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1246/2462] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:02.375395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.392606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda75a8-f080-4c8b-a96b-fad023768edb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.398010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.398719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.399079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.399431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.400160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.401918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.420317 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1217/2463] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:02.421962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.430677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.431812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:02.435594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7434f9b-528d-4b79-8aa7-9965b806eb1e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.440886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1608f-5b7e-4e1f-b0d8-2692a6282ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.441957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1608f-5b7e-4e1f-b0d8-2692a6282ea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.442439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1608f-5b7e-4e1f-b0d8-2692a6282ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.443309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1608f-5b7e-4e1f-b0d8-2692a6282ea0 admin admin] PATH_INFO: `/v3/projects/68399aa04be64186bf2974c9b7a8e63a/users/68aa0e7ab55e46d59f62dddf3217135b/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.460688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1608f-5b7e-4e1f-b0d8-2692a6282ea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68399aa04be64186bf2974c9b7a8e63a, user_id=68aa0e7ab55e46d59f62dddf3217135b, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.465840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1608f-5b7e-4e1f-b0d8-2692a6282ea0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.493764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1247/2464] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:02 2022] PUT /identity/v3/projects/68399aa04be64186bf2974c9b7a8e63a/users/68aa0e7ab55e46d59f62dddf3217135b/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:02.495528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.496083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.496408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.528632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] MFA Rules not processed for user `68aa0e7ab55e46d59f62dddf3217135b`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:02.529894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:02.532134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fa2e17-73f3-47f6-a9f2-d4b7904eb636 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.618839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:02.639381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1248/2465] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:02.641252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.642003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.642463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.642811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.645253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:02.649890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.651389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:02.744453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea87436e-8391-4040-80ff-0ec5b228d920 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.748331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.749238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5fa712-ef65-469a-8113-1c08607a2a11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.749891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa712-ef65-469a-8113-1c08607a2a11 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.750212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa712-ef65-469a-8113-1c08607a2a11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.750347 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.750445 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5fa712-ef65-469a-8113-1c08607a2a11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.759513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa712-ef65-469a-8113-1c08607a2a11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.761007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5fa712-ef65-469a-8113-1c08607a2a11 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:02.763418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1218/2466] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:21:02.778362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1249/2467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:21:02.797643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:02.912327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d249472-1594-401f-918c-3adf2783c442 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:02.932745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:02.933500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:02.938078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:02.938600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] PATH_INFO: `/v3/users/68aa0e7ab55e46d59f62dddf3217135b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:02.940088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68aa0e7ab55e46d59f62dddf3217135b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:02.942544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:03.012796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68aa0e7ab55e46d59f62dddf3217135b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.028227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68aa0e7ab55e46d59f62dddf3217135b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.029214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68aa0e7ab55e46d59f62dddf3217135b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.041564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68aa0e7ab55e46d59f62dddf3217135b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.044192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68aa0e7ab55e46d59f62dddf3217135b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.075153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1219/2468] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:02 2022] DELETE /identity/v3/users/68aa0e7ab55e46d59f62dddf3217135b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:03.079713 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:03.080158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:03.080158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:03.107864 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:03.109347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:03.177922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:03.196692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1250/2469] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:03.203665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:03.205281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:03.239147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:03.294481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1489b-b692-4d6f-8a2f-fa539d69ad06 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:03.298220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff67375-34e3-418d-8898-f1362146574c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:03.298840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67375-34e3-418d-8898-f1362146574c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:03.299124 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67375-34e3-418d-8898-f1362146574c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:03.299401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff67375-34e3-418d-8898-f1362146574c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:03.309541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff67375-34e3-418d-8898-f1362146574c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:03.311046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff67375-34e3-418d-8898-f1362146574c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:03.337957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1220/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:03.760805 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:03.763467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:03.800324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aed7d41-241d-4a3b-a8eb-89ae7e0375ea None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:03.805570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:03.806314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:03.806661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:03.807023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] PATH_INFO: `/v3/projects/68399aa04be64186bf2974c9b7a8e63a` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:03.808322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=68399aa04be64186bf2974c9b7a8e63a)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:03.810958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:03.873297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68399aa04be64186bf2974c9b7a8e63a', 'request_id': 'req-6445649c-a792-4de7-a6e2-52096e646ccd'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.884592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68399aa04be64186bf2974c9b7a8e63a', 'request_id': 'req-6445649c-a792-4de7-a6e2-52096e646ccd'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.892311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68399aa04be64186bf2974c9b7a8e63a', 'request_id': 'req-6445649c-a792-4de7-a6e2-52096e646ccd'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.906480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] The token cache is being invalidate because project 68399aa04be64186bf2974c9b7a8e63a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:03.906779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.907425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-6445649c-a792-4de7-a6e2-52096e646ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:03.909171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1251/2471] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:03 2022] DELETE /identity/v3/projects/68399aa04be64186bf2974c9b7a8e63a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:03.922716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:03.923080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:03.923452 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:03.947726 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:03.949049 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:04.020564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1221/2472] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:04.028279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.028598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.028880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.053115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:04.053115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:04.063337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1252/2473] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:04.067398 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.079921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab833b9-1eda-49d1-83c6-67c16de8c538 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.091106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.092080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.092367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.092644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.093336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:04.093648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.095364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.110032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1222/2474] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:21:04.114606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.125367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa1d2d-9fbb-4ef5-b45a-4544c4ca9522 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.130582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.131260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.131542 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.131819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.132524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.134529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.170129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1253/2475] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:04 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:04.171405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.182172 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856ed74-828e-4b18-adda-ecc2d7732323 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.249598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.250433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.250720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.251489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.253495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.257031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.294758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1223/2476] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:04 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:21:04.299897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.318297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad9ff0-0de5-4583-a7d0-eba3d4464da6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.326201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.327076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.327504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.327912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.328880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.331430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.346208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1254/2477] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:04.357011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.374586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d373a4-d6fd-425d-8a01-efb16cf8b743 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.387482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3fabcb-1ce9-4b79-ae54-4528df0e242c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.389642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fabcb-1ce9-4b79-ae54-4528df0e242c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.394500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fabcb-1ce9-4b79-ae54-4528df0e242c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.394661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3fabcb-1ce9-4b79-ae54-4528df0e242c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.395308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fabcb-1ce9-4b79-ae54-4528df0e242c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.396949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3fabcb-1ce9-4b79-ae54-4528df0e242c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.412688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1224/2478] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:04.419533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.430811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ff83f-7704-4134-9c5a-98f2a5301892 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.436937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.437681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.438050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.438399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] PATH_INFO: `/v3/projects/c096ff351e744a968291cc4324bad315/users/d6c97a36ae8e41adbd5451603fe8b538/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.462829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c096ff351e744a968291cc4324bad315, user_id=d6c97a36ae8e41adbd5451603fe8b538, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.467792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.484199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1255/2479] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:04 2022] PUT /identity/v3/projects/c096ff351e744a968291cc4324bad315/users/d6c97a36ae8e41adbd5451603fe8b538/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:04.505927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.506399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.506837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.557196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] MFA Rules not processed for user `d6c97a36ae8e41adbd5451603fe8b538`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:04.558986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:04.628413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:04.714105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1225/2480] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:04.725770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:04.727990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:04.854382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5d9a2-ffcd-4297-94fe-d1087f2cd25a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:04.858925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:04.859754 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:04.859991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:04.860279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:04.874844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:04.876297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:04.901836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1256/2481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:08.905469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:08.907066 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:08.975903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b9a324-5e34-47b6-8117-e3da68182b2f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:08.979688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:08.980292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:08.980570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:08.980976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:08.982977 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:08.993053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:08.994518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:09.003040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1226/2482] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:14.095300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:14.096704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:14.110522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f16e48-40fa-4cb9-a553-30c196c6c562 service glance] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:14.124265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:14.125007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:14.125354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:14.125686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:14.127865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:14.138874 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:14.140312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:14.148337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1257/2483] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:14.486602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:14.488074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:14.559302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd2196-dcb4-4562-80b3-fa0408f2822d service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:14.564460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:14.565064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:14.565343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:14.565612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:14.567358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:14.578538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:14.580137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4777f83-fa09-46c5-a623-1fb7de91864b service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:14.589715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1227/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:14.823335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:14.825453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:14.835040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:14.919518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82616c8-835b-45b2-a556-96e4cba7f78d service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:14.926345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:14.927129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:14.927637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:14.927980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:14.931236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:14.998775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:15.000413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:15.013942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1258/2485] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:16.517605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:16.518480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:16.518761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:16.540974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:16.542313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:16.595195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:16.611978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1228/2486] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:21:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:16.626973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:16.628389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:16.726986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845954bf-a101-460d-8207-6f5c74ff46bf service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:16.732738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee17d3-9474-4ea4-88df-efa1fec7f90d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:16.733386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee17d3-9474-4ea4-88df-efa1fec7f90d service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:16.733687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee17d3-9474-4ea4-88df-efa1fec7f90d service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:16.734021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee17d3-9474-4ea4-88df-efa1fec7f90d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:16.743263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee17d3-9474-4ea4-88df-efa1fec7f90d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:16.745344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee17d3-9474-4ea4-88df-efa1fec7f90d service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:16.755439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1259/2487] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:21:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:21:21.855539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:21.928088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7bc9-5e3b-40f3-bd59-9bbcc4ba8eb1 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:21.932859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:21.933516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:21.933837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:21.934683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] PATH_INFO: `/v3/users/d6c97a36ae8e41adbd5451603fe8b538` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:21.936395 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c97a36ae8e41adbd5451603fe8b538)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:21.938404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:22.001013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c97a36ae8e41adbd5451603fe8b538'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.015598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c97a36ae8e41adbd5451603fe8b538'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.017013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c97a36ae8e41adbd5451603fe8b538'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.030903 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c97a36ae8e41adbd5451603fe8b538'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.032266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c97a36ae8e41adbd5451603fe8b538'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.052174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1229/2488] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:21 2022] DELETE /identity/v3/users/d6c97a36ae8e41adbd5451603fe8b538 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:22.056779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:22.057317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:22.057421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:22.084002 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:22.085511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:22.120908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:22.152112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1260/2489] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:22.164466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:22.165930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:22.232363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f725d4-0c71-4719-ba8c-ef21f9d7f99a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:22.237000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d6fd5-64cd-4cec-bec1-de62377e4474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:22.237669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6fd5-64cd-4cec-bec1-de62377e4474 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:22.237984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6fd5-64cd-4cec-bec1-de62377e4474 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:22.238314 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d6fd5-64cd-4cec-bec1-de62377e4474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:22.253016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6fd5-64cd-4cec-bec1-de62377e4474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:22.254844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d6fd5-64cd-4cec-bec1-de62377e4474 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:22.268298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1230/2490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:22.631449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:22.632903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:22.654079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a64b43-162f-465b-865e-1cccfe363205 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:22.660511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:22.661512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:22.661924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:22.662269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] PATH_INFO: `/v3/projects/c096ff351e744a968291cc4324bad315` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:22.663847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c096ff351e744a968291cc4324bad315)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:22.666249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:22.727855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c096ff351e744a968291cc4324bad315', 'request_id': 'req-00210834-d2f3-46e4-b92f-5b68361305f0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.736088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c096ff351e744a968291cc4324bad315', 'request_id': 'req-00210834-d2f3-46e4-b92f-5b68361305f0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.743727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c096ff351e744a968291cc4324bad315', 'request_id': 'req-00210834-d2f3-46e4-b92f-5b68361305f0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.761788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] The token cache is being invalidate because project c096ff351e744a968291cc4324bad315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:22.762534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.763563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-00210834-d2f3-46e4-b92f-5b68361305f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:22.768782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1261/2491] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:22 2022] DELETE /identity/v3/projects/c096ff351e744a968291cc4324bad315 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:22.770478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:22.770790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:22.771071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:22.804438 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:22.805673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:22.819861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:22.914542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1231/2492] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:22.916041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:22.916341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:22.916617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:22.945249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:22.946639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:22.959427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1262/2493] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:22.960917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:22.987039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db609b6e-2329-4309-88db-3e36d40e2648 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:22.992048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:22.992974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:22.993490 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:22.994027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:22.994912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:22.995429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:22.997553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.020034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1232/2494] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:21:23.020908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:23.033845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be776-4706-4d29-babe-96f9a014f81a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:23.040380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:23.041198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.041604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.042179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.042845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:23.047044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.087417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1263/2495] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:23 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:23.091923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:23.104368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90481aae-674c-424a-bd4b-f6e8a03dcea7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:23.170548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:23.171164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.171445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.171718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.172390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:23.174369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.200218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1233/2496] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:23 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:23.204274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:23.215079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433fa70-910d-4bd9-92a9-d4cd7a177506 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:23.221052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:23.221793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.222120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.222438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.223146 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:23.224996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.237899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1264/2497] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:23.242092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:23.253458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3cd1-ef7d-4c57-b31b-b2fc7dbfa14b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:23.258361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438a278f-59ad-4c40-ba6f-143d032df1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:23.258991 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a278f-59ad-4c40-ba6f-143d032df1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.259276 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a278f-59ad-4c40-ba6f-143d032df1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.259559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a278f-59ad-4c40-ba6f-143d032df1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.260211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a278f-59ad-4c40-ba6f-143d032df1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:23.262214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438a278f-59ad-4c40-ba6f-143d032df1a8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.274491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1234/2498] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:23.279707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:23.291563 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e2af3-3c64-401f-8315-85609a55296d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:23.314531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:23.315244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.315526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.315799 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] PATH_INFO: `/v3/projects/50106119584a45728b2091af8f1fac2f/users/8d770833178c4a6d927532c71c21b3bc/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.334347 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50106119584a45728b2091af8f1fac2f, user_id=8d770833178c4a6d927532c71c21b3bc, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:23.337060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.351252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1265/2499] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:23 2022] PUT /identity/v3/projects/50106119584a45728b2091af8f1fac2f/users/8d770833178c4a6d927532c71c21b3bc/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:23.357039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe28c9-e44e-4377-86e1-674e3187212c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.357339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe28c9-e44e-4377-86e1-674e3187212c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.357620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe28c9-e44e-4377-86e1-674e3187212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.380073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5dbe28c9-e44e-4377-86e1-674e3187212c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:23.381537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5dbe28c9-e44e-4377-86e1-674e3187212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:23.457738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1235/2500] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:23.465344 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:23.467236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:23.534905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65baedbb-62ea-4bc0-bd03-14cd0b0a24a3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:23.539256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:23.539875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:23.540158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:23.540433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:23.548355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:23.551194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:23.553429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:23.568976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1266/2501] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:28.586108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:28.586580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:28.586685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:28.622686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] MFA Rules not processed for user `8d770833178c4a6d927532c71c21b3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:28.624181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:28.645889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:28.717767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1236/2502] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:28.720854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:28.732474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccda43-8d96-4e4c-a5b2-003b22566462 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:28.738304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:28.739198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:28.740300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:28.740821 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:28.741782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:28.744578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:28.790100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1267/2503] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:28 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:21:28.799282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:28.817436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa0948-208a-4dfd-9158-185a2ed9267c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:28.935922 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:28.936887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:28.937363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:28.938002 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:28.938865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:28.941204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:28.978834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1237/2504] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:28 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:28.983117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:28.996685 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b995b14c-7e83-49f0-af70-8939b1d936ac admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:29.014461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:29.015101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:29.015561 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:29.015980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:29.016835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:29.035362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:29.071901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:29.072949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1268/2505] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:29.093953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31052ec0-1c6c-4101-a642-b69073624785 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:29.100350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:29.101046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:29.101333 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:29.101752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] PATH_INFO: `/v3/projects/87d458831a22411fbf9c87f3b0f3bcf3/users/621da200e6f74403b41d41dce146dd5e/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:29.121261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d458831a22411fbf9c87f3b0f3bcf3, user_id=621da200e6f74403b41d41dce146dd5e, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:29.124833 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:29.144754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1238/2506] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:29 2022] PUT /identity/v3/projects/87d458831a22411fbf9c87f3b0f3bcf3/users/621da200e6f74403b41d41dce146dd5e/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:29.146353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:29.159592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bda926-024b-4e40-8f41-6f4e0ea6e6ae admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:29.242183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:29.243505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:29.244015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:29.244526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:29.245775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:29.249811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:29.263049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1269/2507] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:21:29.267139 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:29.302291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3837d-df51-48f8-a61c-50374b5a1793 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:29.311730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:29.312428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:29.312716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:29.312997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] PATH_INFO: `/v3/projects/87d458831a22411fbf9c87f3b0f3bcf3/users/621da200e6f74403b41d41dce146dd5e/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:29.315039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87d458831a22411fbf9c87f3b0f3bcf3, user_id=621da200e6f74403b41d41dce146dd5e, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:29.318666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:29.339226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1239/2508] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:29 2022] PUT /identity/v3/projects/87d458831a22411fbf9c87f3b0f3bcf3/users/621da200e6f74403b41d41dce146dd5e/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:30.416470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:30.420463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:30.545349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:30.548458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:30.712074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fc0bc-e52f-405a-b22d-44cd6e506739 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:30.739579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:30.751486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dc0f6a-1941-4077-a9a8-6ff54d370805 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:30.759269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:30.759896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:30.760294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:30.760488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:30.763290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:30.779001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:30.781103 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b04b2c-e4b7-4894-a17e-93248810412b service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:30.799310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1240/2509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:30.859320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:30.886539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:30.887166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:30.887996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:30.888478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:30.890791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:30.910576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:30.938788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:30.965113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1270/2510] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:33.998649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65b7b-eb02-4506-b8ec-1dd570913d29 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:33.999194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65b7b-eb02-4506-b8ec-1dd570913d29 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:33.999194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee65b7b-eb02-4506-b8ec-1dd570913d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:34.040589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-5ee65b7b-eb02-4506-b8ec-1dd570913d29 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:34.053830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5ee65b7b-eb02-4506-b8ec-1dd570913d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:34.183349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1241/2511] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 00:21:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:34.199118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:34.201492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:34.326942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba7c6b1-c765-41e1-9115-4d8f9a7fb37d service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:34.334437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:34.339395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:34.339701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:34.339972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:34.353853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:34.355929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:34.392428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1271/2512] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:21:36.876628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68499-d524-4e68-88e6-3738b104f845 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:36.877518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68499-d524-4e68-88e6-3738b104f845 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:36.878009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e68499-d524-4e68-88e6-3738b104f845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:36.923933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-65e68499-d524-4e68-88e6-3738b104f845 None None] MFA Rules not processed for user `621da200e6f74403b41d41dce146dd5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:36.926645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-65e68499-d524-4e68-88e6-3738b104f845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:37.039048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1242/2513] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:37.048268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:37.050520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:37.205602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e962ffe-5552-473e-b75b-499c6aae85e2 service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:37.210137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:37.210820 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:37.211111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:37.211385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:37.311413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:37.315419 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:37.340360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1272/2514] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:37.515089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:37.515383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:37.515668 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:37.540387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:37.541614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:37.550336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1243/2515] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:21:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:37.563643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:37.576038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4ab66e-beb1-46cb-b0e0-f0555b6832bf service glance] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:37.581262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:37.581915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:37.582202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:37.582480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:37.593303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:37.595005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:37.613130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1273/2516] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:21:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:21:37.930491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:37.932629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:38.012389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799132a-5dbc-4aeb-bb72-706cf88c0c64 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:38.021047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:38.021986 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:38.022491 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:38.022978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:38.025108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:38.071469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:38.144741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:38.146426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:38.158639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1244/2517] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:42.439931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:42.450478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:42.490230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:42.541527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:42.543662 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:42.571254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e0de9-b88b-4711-beef-3c8fc2c419ca service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:42.585156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:42.586585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:42.587071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:42.587623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] PATH_INFO: `/v3/users/d8e6d4ffefda4a2ea7ac2ab7b61158e0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:42.590589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8e6d4ffefda4a2ea7ac2ab7b61158e0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:42.594971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:42.596073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3477458-fa5e-4a1c-b7d3-c814223bf211 service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:42.605791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:42.605791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:42.605791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:42.605791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:42.611491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:42.639997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:42.641626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:42.663996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1274/2518] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:42.736090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8e6d4ffefda4a2ea7ac2ab7b61158e0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:42.753198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8e6d4ffefda4a2ea7ac2ab7b61158e0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:42.754028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8e6d4ffefda4a2ea7ac2ab7b61158e0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:42.767759 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8e6d4ffefda4a2ea7ac2ab7b61158e0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:42.768588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-66fc83b0-72ca-40a4-8942-5b48bb6d09f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8e6d4ffefda4a2ea7ac2ab7b61158e0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:42.799904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1245/2519] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:42 2022] DELETE /identity/v3/users/d8e6d4ffefda4a2ea7ac2ab7b61158e0 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:43.201325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.217647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b2726-0ea4-4602-8956-609d9fb4db75 service placement] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.301582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.302883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.302883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.303219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] PATH_INFO: `/v3/projects/b47eda710b6841efbed5b323497e608e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.304526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47eda710b6841efbed5b323497e608e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.306632 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.365791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47eda710b6841efbed5b323497e608e', 'request_id': 'req-2be8df39-5392-482b-9b20-5e1e5ec1d475'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:43.374901 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47eda710b6841efbed5b323497e608e', 'request_id': 'req-2be8df39-5392-482b-9b20-5e1e5ec1d475'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:43.384763 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47eda710b6841efbed5b323497e608e', 'request_id': 'req-2be8df39-5392-482b-9b20-5e1e5ec1d475'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:43.400201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] The token cache is being invalidate because project b47eda710b6841efbed5b323497e608e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:43.400496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:43.401213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2be8df39-5392-482b-9b20-5e1e5ec1d475 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:43.406216 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1275/2520] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:43 2022] DELETE /identity/v3/projects/b47eda710b6841efbed5b323497e608e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:43.407966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.408255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.408695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.430038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:43.431510 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:43.507014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1246/2521] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:43.514711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.515774 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.516053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.537840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:43.539599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:43.555853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1276/2522] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:21:43.557413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.569477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251e927-901b-4eed-9357-b69e919aaa9f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.579473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.580742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.581413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.582062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.583023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:43.583545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.586051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.607961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1247/2523] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:21:43.609208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.621880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10444f4-ddb3-4c19-8515-677a7f717d83 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.628407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.629892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.630178 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.630452 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.631093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.633070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.670271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1277/2524] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:43 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:43.671496 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.682344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da09b1-9ce2-49c9-8d35-3a17f4ec9c35 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.709889 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:43.767971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.769186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.769477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.769792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.770449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.772602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.802090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1248/2525] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:43 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:43.803101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.811172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:43.818808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95b3d5-6018-4420-9a6f-32eb3f3534e0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.827292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.827891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.828182 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.828459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.829114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.832799 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.844626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1278/2526] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:43.848284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.859225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28378b-5fe5-45e8-951b-d2d0b4b06e53 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.865579 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0f3ec-b1e4-4e00-bdf2-c9dd46dd497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.866303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f3ec-b1e4-4e00-bdf2-c9dd46dd497e admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.866588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f3ec-b1e4-4e00-bdf2-c9dd46dd497e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.866867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0f3ec-b1e4-4e00-bdf2-c9dd46dd497e admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.867527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0f3ec-b1e4-4e00-bdf2-c9dd46dd497e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.869155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0f3ec-b1e4-4e00-bdf2-c9dd46dd497e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.881522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1249/2527] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:43.885850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:43.897999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5475e-ce30-423b-ac1a-c3624c03c5ad admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:43.902782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:43.903487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.903770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.904051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] PATH_INFO: `/v3/projects/6fa1dd88f8164125a2a055f6b841a919/users/7dcb19d578364d319c641cc45b67c805/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.929223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa1dd88f8164125a2a055f6b841a919, user_id=7dcb19d578364d319c641cc45b67c805, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:43.932162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:43.952196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1279/2528] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:43 2022] PUT /identity/v3/projects/6fa1dd88f8164125a2a055f6b841a919/users/7dcb19d578364d319c641cc45b67c805/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:43.962549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:43.963178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:43.963460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:43.995931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] MFA Rules not processed for user `7dcb19d578364d319c641cc45b67c805`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:43.997752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:44.080315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1250/2529] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:44.095546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:44.098313 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:44.221057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:44.223920 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:44.236097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a32d8f-6c80-4926-81d6-856725a42c2d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:44.243242 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:44.244000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:44.244284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:44.245232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:44.256550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:44.258326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:44.270017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1280/2530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:44.336255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a111f02-77a7-4999-96c2-22d3369cc907 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:44.340054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:44.340664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:44.341117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:44.341521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:44.344874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:44.413741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:44.447072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:44.448622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:44.461646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1251/2531] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:49.043896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:49.057428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce138c-c096-472a-beaa-f2fc427f1c8e service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:49.063728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:49.064479 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.064832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.065206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] PATH_INFO: `/v3/users/7dcb19d578364d319c641cc45b67c805` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.066424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dcb19d578364d319c641cc45b67c805)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:49.068433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:49.141998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dcb19d578364d319c641cc45b67c805'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.152656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dcb19d578364d319c641cc45b67c805'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.153721 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dcb19d578364d319c641cc45b67c805'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.171798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:49.173980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.192249 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fa2b8-26f0-4749-a9c1-a7ab872cb51d service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:49.197941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:49.198607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.198895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.199186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] PATH_INFO: `/v3/users/a7a214f6d0fa424e8c54e1934e0a6fa9` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.201182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a214f6d0fa424e8c54e1934e0a6fa9)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:49.203228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:49.204267 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dcb19d578364d319c641cc45b67c805'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.218411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f331fce8-e6ce-44c7-8416-3a2077013392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dcb19d578364d319c641cc45b67c805'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.241767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1281/2532] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:49 2022] DELETE /identity/v3/users/7dcb19d578364d319c641cc45b67c805 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:49.242753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.243043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.243494 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.270118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:49.271380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.291584 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a214f6d0fa424e8c54e1934e0a6fa9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.297671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:49.299529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a214f6d0fa424e8c54e1934e0a6fa9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.300247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a214f6d0fa424e8c54e1934e0a6fa9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.333770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a214f6d0fa424e8c54e1934e0a6fa9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.333770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a214f6d0fa424e8c54e1934e0a6fa9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.355797 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1252/2533] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:49 2022] DELETE /identity/v3/users/a7a214f6d0fa424e8c54e1934e0a6fa9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:49.361187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1282/2534] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:21:49.371385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:49.373843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.455883 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae5dae-62d7-4776-8367-0fe18706f2f2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:49.460177 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709e1e0-95a1-49dd-ab90-e64f6d870597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:49.460970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e1e0-95a1-49dd-ab90-e64f6d870597 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.461248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e1e0-95a1-49dd-ab90-e64f6d870597 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.461522 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709e1e0-95a1-49dd-ab90-e64f6d870597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.539081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e1e0-95a1-49dd-ab90-e64f6d870597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:49.542918 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709e1e0-95a1-49dd-ab90-e64f6d870597 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:49.555186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1253/2535] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:49.624042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:49.626074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.660259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be496347-5fa5-4f42-9292-cfe6f9ad3618 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:49.677961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:49.682341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.682786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.683222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] PATH_INFO: `/v3/projects/e958bcb778544b6a94c134030250d177` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.685808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e958bcb778544b6a94c134030250d177)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:49.688341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:49.754677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e958bcb778544b6a94c134030250d177', 'request_id': 'req-d3e0656f-99eb-4ec4-abf1-93e57df78c87'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.781058 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e958bcb778544b6a94c134030250d177', 'request_id': 'req-d3e0656f-99eb-4ec4-abf1-93e57df78c87'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.789377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e958bcb778544b6a94c134030250d177', 'request_id': 'req-d3e0656f-99eb-4ec4-abf1-93e57df78c87'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.804753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] The token cache is being invalidate because project e958bcb778544b6a94c134030250d177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:49.806000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.806693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:49.814785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16bcd-2146-4f8d-8adf-f73bfe455d4a None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.815422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16bcd-2146-4f8d-8adf-f73bfe455d4a None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.815707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b16bcd-2146-4f8d-8adf-f73bfe455d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.818481 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1283/2536] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:49 2022] DELETE /identity/v3/projects/e958bcb778544b6a94c134030250d177 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:49.825095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:49.845923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c3b16bcd-2146-4f8d-8adf-f73bfe455d4a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:49.847158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c3b16bcd-2146-4f8d-8adf-f73bfe455d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.931059 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:49.932611 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.941485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1254/2537] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:49.951536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.951976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.952355 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.952478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0656f-99eb-4ec4-abf1-93e57df78c87 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:49.957319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:49.958104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:49.958385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:49.958656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] PATH_INFO: `/v3/projects/6fa1dd88f8164125a2a055f6b841a919` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:49.959861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa1dd88f8164125a2a055f6b841a919)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:49.961756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:49.983716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:49.985734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:49.997750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1255/2538] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:21:50.001953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.015007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3065a0-4775-4d70-917b-02bc4355f0d7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.024029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa1dd88f8164125a2a055f6b841a919', 'request_id': 'req-58ade25c-1d5a-4447-b8cd-a89453a98bdd'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:50.034782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa1dd88f8164125a2a055f6b841a919', 'request_id': 'req-58ade25c-1d5a-4447-b8cd-a89453a98bdd'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:50.043078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa1dd88f8164125a2a055f6b841a919', 'request_id': 'req-58ade25c-1d5a-4447-b8cd-a89453a98bdd'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:50.056250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] The token cache is being invalidate because project 6fa1dd88f8164125a2a055f6b841a919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:50.056810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:50.057311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-58ade25c-1d5a-4447-b8cd-a89453a98bdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:50.059391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1284/2539] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:49 2022] DELETE /identity/v3/projects/6fa1dd88f8164125a2a055f6b841a919 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:50.064771 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.065247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.065587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.082357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.082979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.083400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.083681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.084701 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:50.085010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.086660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e116ae-ed13-45ab-88c5-ac157d361be1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.093163 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:50.094687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.102683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1256/2540] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:21:50.102683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.102683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.102683 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.103145 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1285/2541] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:50.104031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.110924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.121664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] MFA Rules not processed for user `8d770833178c4a6d927532c71c21b3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:50.123456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c97096-a582-4be0-8806-10edc1257644 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.123652 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.128256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b2dac-388d-4311-aaf1-3a0834f4897b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.128853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2dac-388d-4311-aaf1-3a0834f4897b admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.129136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2dac-388d-4311-aaf1-3a0834f4897b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.129409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b2dac-388d-4311-aaf1-3a0834f4897b admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.130075 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b2dac-388d-4311-aaf1-3a0834f4897b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.131956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b2dac-388d-4311-aaf1-3a0834f4897b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.158823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1286/2542] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:50.160136 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.160428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.160702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.170169 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:50.182745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:50.184233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1257/2543] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:50.185906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.186402 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.197687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c6017b-a488-4ed2-ab1f-98fc36f11398 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.239004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:50.259849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1287/2544] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:50.267004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.267640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.268280 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.268565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.268841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.269470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.271469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.276309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58708a82-785f-4149-a64b-24f91912dd54 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.281133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.281760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.282044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.282315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.283282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:50.283473 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.285433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.294971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1258/2545] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/users => generated 284 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:50.298741 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.306004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1288/2546] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:21:50.306962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.309151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2936d533-dbeb-49d1-a821-535850402f05 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.314776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.315466 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.315812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.316181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.316900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.318618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.318753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a8094-eda0-48d7-acd9-78a6d207af39 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.324708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.325339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.325655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.325937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.327246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.329180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.330653 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1259/2547] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:21:50.334562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.345907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b2ca24-8fc5-4b5f-881b-dcface2b55ca admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.351618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.352301 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.352659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.352940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.353698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.357062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.369062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1289/2548] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/projects => generated 403 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:21:50.369259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1260/2549] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:50.371004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.374693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.386219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed6934d-0091-47ee-975d-91201e9a65c6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.446389 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24683cc4-8c6a-4119-90e8-73e5fa20000f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.453297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.453476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650859b-01ce-4d54-b6d2-1de323e066aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.454184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650859b-01ce-4d54-b6d2-1de323e066aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.454473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650859b-01ce-4d54-b6d2-1de323e066aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.454751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650859b-01ce-4d54-b6d2-1de323e066aa admin admin] PATH_INFO: `/v3/projects/b18ed1a3749d433e97b0f1b3f4fc05ff/users/96e5e825ee654f0286b24092bdb61ba0/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.455411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.455786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.456154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.456990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.459291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.484871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650859b-01ce-4d54-b6d2-1de323e066aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18ed1a3749d433e97b0f1b3f4fc05ff, user_id=96e5e825ee654f0286b24092bdb61ba0, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.487808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650859b-01ce-4d54-b6d2-1de323e066aa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.491908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1290/2550] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/users => generated 302 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:50.494653 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.506667 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1261/2551] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:50 2022] PUT /identity/v3/projects/b18ed1a3749d433e97b0f1b3f4fc05ff/users/96e5e825ee654f0286b24092bdb61ba0/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:50.513467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d5099-7007-4f59-98f0-6a379dd23340 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.517334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.517732 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.518108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.549766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] MFA Rules not processed for user `96e5e825ee654f0286b24092bdb61ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:50.551129 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.589270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.589946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.590234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.590509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.591767 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.593366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.594848 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:50.605691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1291/2552] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:50.612194 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.630407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23656a7-2e84-4a04-bb08-da7e6f7fe5b4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.636327 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.636979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.637573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.637573 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.638037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1262/2553] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:50.639008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.641108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.649603 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.651345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.659920 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1292/2554] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:50.664398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.676729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8da66-1786-4b1d-8e73-1125e53b50a6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.680359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:50.683305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2313fbd6-44ca-4fd2-be77-c9210c9184a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.683980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fbd6-44ca-4fd2-be77-c9210c9184a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.684269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fbd6-44ca-4fd2-be77-c9210c9184a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.684612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313fbd6-44ca-4fd2-be77-c9210c9184a8 admin admin] PATH_INFO: `/v3/projects/8be2ba12e22342b9931dee2089b208e8/users/3d2514dc91e541fbafa3a8a2f631f083/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.701862 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313fbd6-44ca-4fd2-be77-c9210c9184a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8be2ba12e22342b9931dee2089b208e8, user_id=3d2514dc91e541fbafa3a8a2f631f083, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.704990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2313fbd6-44ca-4fd2-be77-c9210c9184a8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.721314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1293/2555] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:50 2022] PUT /identity/v3/projects/8be2ba12e22342b9931dee2089b208e8/users/3d2514dc91e541fbafa3a8a2f631f083/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:50.734032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.734339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.734620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.742356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de33efeb-6648-4306-b21e-4f2d55349958 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.774089 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] MFA Rules not processed for user `3d2514dc91e541fbafa3a8a2f631f083`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:50.775951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:50.805112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.805925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.806409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.806754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.885300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.886733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1294/2556] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:21:50.887472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:50.891621 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:50.900243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1263/2557] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:21:50.972734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12787ea-19a3-4ea6-849e-9b961c04a491 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:50.978377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:50.978991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:50.979263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:50.979645 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:50.980179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:50.982710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.015929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1295/2558] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:50 2022] POST /identity/v3/projects => generated 403 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:21:51.017085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.029102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad2a43-1e2d-4671-b750-bc446c9892c4 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.114501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.115219 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.115513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.115807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.116546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.118864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.143443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1264/2559] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:51 2022] POST /identity/v3/users => generated 308 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:21:51.148184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.161939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a838b0-cc67-46c6-9d04-5c7235109606 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.167470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.168093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.168364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.168646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.169922 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.171687 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.186355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1296/2560] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:21:51.190548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.202372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c00c0-9686-4818-88d6-ba27c0821103 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.207410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.208034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.208374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.208642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] PATH_INFO: `/v3/projects/e4032124e3fa4d4f90689ac7d9838064/users/a6829797af6140379d8cae0601f5cc33/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.227531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4032124e3fa4d4f90689ac7d9838064, user_id=a6829797af6140379d8cae0601f5cc33, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.230593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.233619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:51.258964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1265/2561] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:51 2022] PUT /identity/v3/projects/e4032124e3fa4d4f90689ac7d9838064/users/a6829797af6140379d8cae0601f5cc33/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:51.264090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.280153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa5934-59b5-4774-8c36-a298461dd701 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.310094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:51.355695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f0397-e3e5-4179-9728-24312552b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.356308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0397-e3e5-4179-9728-24312552b7ce admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.357221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0397-e3e5-4179-9728-24312552b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.357459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f0397-e3e5-4179-9728-24312552b7ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.358338 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0397-e3e5-4179-9728-24312552b7ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.359931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360f0397-e3e5-4179-9728-24312552b7ce admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.371290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1297/2562] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:51 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:51.375913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.389008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af1b49a-8a2b-4656-8ece-767dbf6967d1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.394201 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.394950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.395456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.395738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] PATH_INFO: `/v3/projects/e4032124e3fa4d4f90689ac7d9838064/users/a6829797af6140379d8cae0601f5cc33/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.397665 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4032124e3fa4d4f90689ac7d9838064, user_id=a6829797af6140379d8cae0601f5cc33, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.400340 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.412406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1266/2563] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:51 2022] PUT /identity/v3/projects/e4032124e3fa4d4f90689ac7d9838064/users/a6829797af6140379d8cae0601f5cc33/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:51.425035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.425303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.425577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.455118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] MFA Rules not processed for user `a6829797af6140379d8cae0601f5cc33`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:51.456800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:51.532986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1298/2564] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:51.544453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.613011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992160a-de33-414c-aebc-6c8808ccebd3 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.616814 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb918a2-5af2-4d4a-8f7d-c73a412521a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.617426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb918a2-5af2-4d4a-8f7d-c73a412521a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.617739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb918a2-5af2-4d4a-8f7d-c73a412521a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.618015 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb918a2-5af2-4d4a-8f7d-c73a412521a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.627937 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb918a2-5af2-4d4a-8f7d-c73a412521a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.629377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb918a2-5af2-4d4a-8f7d-c73a412521a1 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.639075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1267/2565] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:51 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:51.775526 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:51.841581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e241ed2-78ef-4ddd-af83-5cc323e35113 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:51.846603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:51.847230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.847512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.847784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] PATH_INFO: `/v3/users/3d2514dc91e541fbafa3a8a2f631f083` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.848919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2514dc91e541fbafa3a8a2f631f083)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:51.851004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:51.903142 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2514dc91e541fbafa3a8a2f631f083'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:51.904421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:51.913988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2514dc91e541fbafa3a8a2f631f083'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:51.914733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2514dc91e541fbafa3a8a2f631f083'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:51.930434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2514dc91e541fbafa3a8a2f631f083'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:51.940525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2514dc91e541fbafa3a8a2f631f083'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:51.948084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1299/2566] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:51 2022] DELETE /identity/v3/users/3d2514dc91e541fbafa3a8a2f631f083 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:51.953306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce0f0-ec91-4da1-8daa-0c877e063ec4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:51.953630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce0f0-ec91-4da1-8daa-0c877e063ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:51.954009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ce0f0-ec91-4da1-8daa-0c877e063ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:51.980651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b59ce0f0-ec91-4da1-8daa-0c877e063ec4 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:51.983975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b59ce0f0-ec91-4da1-8daa-0c877e063ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.065506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1268/2567] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:52.075958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:52.077659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.143666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35cf4b-e4b4-4a95-b24d-3c2a5854ca86 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:52.147535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:52.148151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:52.148437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:52.148994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:52.161602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:52.163516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:52.176943 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1300/2568] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:21:52.279375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:52.279960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:52.280216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:52.308368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:52.311336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.408294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1269/2569] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:21:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:52.434729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:52.436701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.489209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:52.491532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.522927 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476a98-c4a2-456a-b55d-c626542fc4a4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:52.530356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:52.531217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:52.531338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:52.531544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] PATH_INFO: `/v3/projects/8be2ba12e22342b9931dee2089b208e8` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:52.532709 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8be2ba12e22342b9931dee2089b208e8)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:52.534815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:52.568631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:52.605214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8be2ba12e22342b9931dee2089b208e8', 'request_id': 'req-ad52c2ef-072e-4fba-8382-3c85f9767a8e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.609158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84584c90-1da7-406d-8f18-1d2e68a243a7 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:52.616206 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8be2ba12e22342b9931dee2089b208e8', 'request_id': 'req-ad52c2ef-072e-4fba-8382-3c85f9767a8e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.624934 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8be2ba12e22342b9931dee2089b208e8', 'request_id': 'req-ad52c2ef-072e-4fba-8382-3c85f9767a8e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.638737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] The token cache is being invalidate because project 8be2ba12e22342b9931dee2089b208e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:52.639750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.640707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.643120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1270/2570] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:52 2022] DELETE /identity/v3/projects/8be2ba12e22342b9931dee2089b208e8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:52.647567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:52.649162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.691966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:52.692944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:52.693129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:52.693518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:52.696256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:52.707678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:52.765813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52c2ef-072e-4fba-8382-3c85f9767a8e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:52.775427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:52.777828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:52.777828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:52.778026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] PATH_INFO: `/v3/users/a6829797af6140379d8cae0601f5cc33` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:52.783039 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6829797af6140379d8cae0601f5cc33)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:52.791469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:52.799602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:52.803036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:52.824262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1301/2571] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:21:52.910267 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6829797af6140379d8cae0601f5cc33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.948660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6829797af6140379d8cae0601f5cc33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.952082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6829797af6140379d8cae0601f5cc33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.970436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6829797af6140379d8cae0601f5cc33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:52.971183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-68680fe1-4ac8-4162-a731-1bd279360cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6829797af6140379d8cae0601f5cc33'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:53.019325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1271/2572] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:21:52 2022] DELETE /identity/v3/users/a6829797af6140379d8cae0601f5cc33 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:53.653378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:53.695083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455bed0-9009-45b2-a9fd-46bcf32781ff service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:53.830303 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:53.831622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:53.832320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:53.833056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] PATH_INFO: `/v3/projects/e4032124e3fa4d4f90689ac7d9838064` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:53.840789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4032124e3fa4d4f90689ac7d9838064)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:53.844866 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:53.938269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4032124e3fa4d4f90689ac7d9838064', 'request_id': 'req-ec4bf398-bf38-4c40-9498-fb1f56212388'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:53.948385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4032124e3fa4d4f90689ac7d9838064', 'request_id': 'req-ec4bf398-bf38-4c40-9498-fb1f56212388'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:53.956296 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4032124e3fa4d4f90689ac7d9838064', 'request_id': 'req-ec4bf398-bf38-4c40-9498-fb1f56212388'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:53.967454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] The token cache is being invalidate because project e4032124e3fa4d4f90689ac7d9838064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:21:53.967741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:53.968393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ec4bf398-bf38-4c40-9498-fb1f56212388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:21:53.970320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1302/2573] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:21:53 2022] DELETE /identity/v3/projects/e4032124e3fa4d4f90689ac7d9838064 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:53.978805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:53.979365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:53.979564 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.026919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:54.028540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:54.089218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:54.146608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1272/2574] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:54.154724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.155007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.155282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.180792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:54.182091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:54.192213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1303/2575] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:54.197238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.216894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb533b-8222-4d39-9048-5e418cd73f52 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.222828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.223451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.223736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.224014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.224680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:21:54.224987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.226649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.241838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1273/2576] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:21:54.246147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.259243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22850e6e-d8f6-4290-a032-0ed25478777d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.267939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.268565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.268860 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.269118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.269807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.271810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.309833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1304/2577] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:54 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:54.311696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.329207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7722e8b-6ad3-4c3c-a179-86534aac19d9 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.459105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.459740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.460023 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.460300 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.460950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.462933 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.527215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1274/2578] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:54 2022] POST /identity/v3/users => generated 291 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:54.531036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.547090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb9cfe-1719-4831-b7e7-18cd0a04a859 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.562697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.563450 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.563838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.564361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.565130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.566853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.587597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1305/2579] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:54.593350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.618407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d741c-aded-4530-b48c-51d03baf3237 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.633561 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8b4ff-2df1-4745-9bb1-78962db32652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.634248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8b4ff-2df1-4745-9bb1-78962db32652 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.634530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8b4ff-2df1-4745-9bb1-78962db32652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.634801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8b4ff-2df1-4745-9bb1-78962db32652 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.635465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8b4ff-2df1-4745-9bb1-78962db32652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.637187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8b4ff-2df1-4745-9bb1-78962db32652 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.655568 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1275/2580] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:54.660650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.667762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:54.687535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141f5b0-fbc0-4aa3-aa4e-ed5514458cbe admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.687535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.687535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.687535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.687886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] PATH_INFO: `/v3/projects/64e043faead14932a88ffd01e7543cee/users/3abea053f9374240ab9381b91eb9a1b4/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.702640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e043faead14932a88ffd01e7543cee, user_id=3abea053f9374240ab9381b91eb9a1b4, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.705378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.722509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1306/2581] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:54 2022] PUT /identity/v3/projects/64e043faead14932a88ffd01e7543cee/users/3abea053f9374240ab9381b91eb9a1b4/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:21:54.733873 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.734251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.734867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.773041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] MFA Rules not processed for user `3abea053f9374240ab9381b91eb9a1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:54.774363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:54.854226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1276/2582] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:21:54.859434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.941801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c0df4-4114-4bec-90c7-d4e0c5c28484 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:54.946646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:54.947264 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:54.947574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:54.947861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:54.948500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:54.950652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:54.990190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:54.992040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1307/2583] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:21:54 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:55.006166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9444892-c4f1-4a7f-af69-3bcaa908218c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:55.035324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:55.077957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:55.078574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.078857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.079136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.079775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:55.081744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:55.109304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1277/2584] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:21:54 2022] POST /identity/v3/users => generated 299 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:21:55.113737 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:55.125559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540a6b4-d988-47c0-8be0-1b9740c70791 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:55.130607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:55.131311 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.131664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.131951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.132600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:55.134235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:55.146158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1308/2585] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:21:55.150389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:55.168416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f91387-ba93-452c-a7d7-db527ab870ea admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:55.174610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:55.175733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.176236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.176682 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] PATH_INFO: `/v3/projects/6cdc3dee82454981ab655d79ea9bcf2e/users/65fc98511d404c7e944852ccc9fc32b0/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.198250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdc3dee82454981ab655d79ea9bcf2e, user_id=65fc98511d404c7e944852ccc9fc32b0, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:55.202359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:55.216894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1278/2586] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:55 2022] PUT /identity/v3/projects/6cdc3dee82454981ab655d79ea9bcf2e/users/65fc98511d404c7e944852ccc9fc32b0/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:55.221257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:55.233430 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7547c77-5340-44d1-96ab-10197bd85e48 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:55.293435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b805e-148b-41ed-a19d-59d8ad92b1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:55.294035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b805e-148b-41ed-a19d-59d8ad92b1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.294400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b805e-148b-41ed-a19d-59d8ad92b1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.294682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b805e-148b-41ed-a19d-59d8ad92b1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.295366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b805e-148b-41ed-a19d-59d8ad92b1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:55.296979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b805e-148b-41ed-a19d-59d8ad92b1f4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:55.308210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1309/2587] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:21:55.313162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:55.324424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f272f-ff1c-4a4a-8687-225074cf4ff1 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:55.330754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:55.331531 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.331812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.332081 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] PATH_INFO: `/v3/projects/6cdc3dee82454981ab655d79ea9bcf2e/users/65fc98511d404c7e944852ccc9fc32b0/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.334078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdc3dee82454981ab655d79ea9bcf2e, user_id=65fc98511d404c7e944852ccc9fc32b0, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:55.337085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:55.348478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1279/2588] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:21:55 2022] PUT /identity/v3/projects/6cdc3dee82454981ab655d79ea9bcf2e/users/65fc98511d404c7e944852ccc9fc32b0/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:21:55.361220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.361521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.361841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.394031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] MFA Rules not processed for user `65fc98511d404c7e944852ccc9fc32b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:21:55.395420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:55.440496 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:21:55.477804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1310/2589] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:21:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:21:55.491411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:21:55.493429 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:21:55.583826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20849af9-205d-44ab-8dc7-1137faff409d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:21:55.588293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:21:55.588987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:21:55.589369 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:21:55.589730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:21:55.671016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:21:55.672544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:21:55.683342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1280/2590] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:21:55 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:00.077398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:00.078974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:00.152706 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9eb23-9ff9-49d7-ab53-6569370df69c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:00.160116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:00.161020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:00.161499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:00.161998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] PATH_INFO: `/v3/users/96e5e825ee654f0286b24092bdb61ba0` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:00.163600 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e5e825ee654f0286b24092bdb61ba0)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:00.165946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:00.236530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e5e825ee654f0286b24092bdb61ba0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:00.242721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:00.251005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e5e825ee654f0286b24092bdb61ba0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:00.252193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e5e825ee654f0286b24092bdb61ba0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:00.253948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d2181-cd3a-45c1-8b28-56ae75e97a9a service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:00.258128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:00.258771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:00.259058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:00.259335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:00.266014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e5e825ee654f0286b24092bdb61ba0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:00.268909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:00.270413 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:00.274132 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-ac73b5dc-a7b7-49a4-9e59-5ec59d6cabe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e5e825ee654f0286b24092bdb61ba0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:00.284453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1311/2591] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:00 2022] DELETE /identity/v3/users/96e5e825ee654f0286b24092bdb61ba0 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:00.285880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1281/2592] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:00.288999 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:00.289369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:00.289764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:00.315234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:00.316715 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:00.394752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:00.415661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1312/2593] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:00.426762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:00.428734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:00.480935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:00.543447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69a0d5-619a-4f13-8d16-4a839aca819c service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:00.623704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a49c7-2abd-4691-a2ae-51680c474a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:00.624048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a49c7-2abd-4691-a2ae-51680c474a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:00.624306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a49c7-2abd-4691-a2ae-51680c474a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:00.624582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a49c7-2abd-4691-a2ae-51680c474a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:00.638511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a49c7-2abd-4691-a2ae-51680c474a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:00.640572 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a49c7-2abd-4691-a2ae-51680c474a9c service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:00.671581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1282/2594] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:01.260444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.262427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:01.289641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff150d-f4ae-4e99-96ce-6f675d79e352 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.306352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.307015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.307364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.307559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] PATH_INFO: `/v3/projects/b18ed1a3749d433e97b0f1b3f4fc05ff` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.311572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18ed1a3749d433e97b0f1b3f4fc05ff)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.313836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.368952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18ed1a3749d433e97b0f1b3f4fc05ff', 'request_id': 'req-b2757b99-8992-40b1-8324-4743378c6b53'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:01.379580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18ed1a3749d433e97b0f1b3f4fc05ff', 'request_id': 'req-b2757b99-8992-40b1-8324-4743378c6b53'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:01.388827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18ed1a3749d433e97b0f1b3f4fc05ff', 'request_id': 'req-b2757b99-8992-40b1-8324-4743378c6b53'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:01.399785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] The token cache is being invalidate because project b18ed1a3749d433e97b0f1b3f4fc05ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:01.400083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:01.400753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b2757b99-8992-40b1-8324-4743378c6b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:01.402371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1313/2595] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:01 2022] DELETE /identity/v3/projects/b18ed1a3749d433e97b0f1b3f4fc05ff => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:01.407815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.408331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.408434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.430866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:01.432094 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:01.498098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1283/2596] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:01.505684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.506005 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.506285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.526288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:01.527503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:01.535622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1314/2597] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:01.540144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.550932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e0bc23-da10-413f-9fea-afb8536d8b58 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.555559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.556160 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.556448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.556725 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.557382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:01.557692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.559337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.571606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1284/2598] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:01.575966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.585745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd499462-5d0f-421b-aa71-062f6e4fa1ac None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.590984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.591675 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.591962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.592239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.592892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.594871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.623956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1315/2599] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:01 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:01.628331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.638713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca57864-fe2e-4a2d-87b6-59c0f21f953c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.701218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.701855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.702142 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.702418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.703070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.704998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.718604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:01.730349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1285/2600] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:01 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:01.735275 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.745789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea4018-d386-47db-820f-514f6b724256 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.750772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.751365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.751650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.751926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.752570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.754734 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.764652 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1316/2601] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:01.768928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.780298 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff059c-6d44-4238-9eb1-c77e7c30b7b2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.785188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cf6c6-2a01-4c55-9b63-52b6210140cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.785836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf6c6-2a01-4c55-9b63-52b6210140cc admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.786123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf6c6-2a01-4c55-9b63-52b6210140cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.786399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cf6c6-2a01-4c55-9b63-52b6210140cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.787054 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cf6c6-2a01-4c55-9b63-52b6210140cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.788932 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cf6c6-2a01-4c55-9b63-52b6210140cc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.803478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1286/2602] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:01.805122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:01.816250 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430db78-6042-41f9-9658-e49105dcc2b9 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:01.821080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:01.821753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.822041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.822317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] PATH_INFO: `/v3/projects/40778fdd03a14789aa2a4ab73279bcd4/users/e29591fa84844abb9c123f7d91849b03/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.839555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40778fdd03a14789aa2a4ab73279bcd4, user_id=e29591fa84844abb9c123f7d91849b03, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:01.843798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:01.858897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1317/2603] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:01 2022] PUT /identity/v3/projects/40778fdd03a14789aa2a4ab73279bcd4/users/e29591fa84844abb9c123f7d91849b03/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:01.870792 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:01.871092 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:01.871516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:01.903374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] MFA Rules not processed for user `e29591fa84844abb9c123f7d91849b03`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:01.904752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:01.979917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1287/2604] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:01.984587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.057306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736561b-7a54-4d65-bf7b-a66b57c81469 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.063491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.064161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.064448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.064729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.065435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.067361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.092151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:02.107356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1318/2605] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:01 2022] POST /identity/v3/projects => generated 369 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:02.111885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.124655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86684d1c-9841-4c38-85ff-4357875409a3 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.198181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.198860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.199514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.199807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.200837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.203051 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.226310 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1288/2606] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:02 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:02.230255 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.253952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d48dc5-398b-425b-a78a-0cdfd49d03cf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.253952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.253952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.253952 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.254355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.254355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.254355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.267970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1319/2607] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:02.269143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.279389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283073b-f7d6-48f6-9be5-1c5abc0d56e0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.284099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.284758 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.285046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.285327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] PATH_INFO: `/v3/projects/8f7efb81b27d49eba34ecdf23032ee66/users/60691fbfedb14fd9a177958f91acca35/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.301439 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7efb81b27d49eba34ecdf23032ee66, user_id=60691fbfedb14fd9a177958f91acca35, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.304120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.318269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1289/2608] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:02 2022] PUT /identity/v3/projects/8f7efb81b27d49eba34ecdf23032ee66/users/60691fbfedb14fd9a177958f91acca35/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:02.322297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.333392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3fa3ce-7900-4089-9134-8cebb63d0a35 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.393185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66808a09-db6e-42d3-a880-032b123cc937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.393827 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808a09-db6e-42d3-a880-032b123cc937 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.394109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808a09-db6e-42d3-a880-032b123cc937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.394386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66808a09-db6e-42d3-a880-032b123cc937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.395024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66808a09-db6e-42d3-a880-032b123cc937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.396637 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66808a09-db6e-42d3-a880-032b123cc937 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.406724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1320/2609] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:02.411167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.422795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceea40d-61d6-4ee9-8568-ae3a5f7e0a7d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.427501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.428159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.428446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.428723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] PATH_INFO: `/v3/projects/8f7efb81b27d49eba34ecdf23032ee66/users/60691fbfedb14fd9a177958f91acca35/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.430712 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7efb81b27d49eba34ecdf23032ee66, user_id=60691fbfedb14fd9a177958f91acca35, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.433377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.445053 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1290/2610] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:02 2022] PUT /identity/v3/projects/8f7efb81b27d49eba34ecdf23032ee66/users/60691fbfedb14fd9a177958f91acca35/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:02.455517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.455810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.456092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.485655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] MFA Rules not processed for user `60691fbfedb14fd9a177958f91acca35`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:02.486919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:02.557977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1321/2611] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:02.568832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:02.570655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:02.603010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:02.631511 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65feada-3f1c-4718-a4ae-48038e90dcaa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:02.635134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c16bb4-1ea0-43fe-8621-6a5a92624034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:02.636330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c16bb4-1ea0-43fe-8621-6a5a92624034 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:02.636330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c16bb4-1ea0-43fe-8621-6a5a92624034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:02.636330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c16bb4-1ea0-43fe-8621-6a5a92624034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:02.645322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c16bb4-1ea0-43fe-8621-6a5a92624034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:02.646786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c16bb4-1ea0-43fe-8621-6a5a92624034 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:02.656738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1291/2612] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:04.034373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:04.096664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cff9ba-a854-445a-99ca-a03e0eee2e86 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:04.101065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:04.101686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:04.102001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:04.102278 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] PATH_INFO: `/v3/users/e29591fa84844abb9c123f7d91849b03` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:04.103385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e29591fa84844abb9c123f7d91849b03)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:04.105339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:04.116166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:04.161427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e29591fa84844abb9c123f7d91849b03'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.171247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e29591fa84844abb9c123f7d91849b03'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.172006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e29591fa84844abb9c123f7d91849b03'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.187068 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e29591fa84844abb9c123f7d91849b03'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.199135 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e29591fa84844abb9c123f7d91849b03'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.211788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1322/2613] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:04 2022] DELETE /identity/v3/users/e29591fa84844abb9c123f7d91849b03 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:04.214024 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:04.214514 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:04.214815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:04.244866 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:04.246404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:04.313093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1292/2614] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:04.323924 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:04.325412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:04.396343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48e501-09fc-4f90-90eb-7d233b58e1fd admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:04.400522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:04.401111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:04.402017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:04.402017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:04.412535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:04.414432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:04.425434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1323/2615] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:04.719153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:04.720802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:04.733558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d25f71-c0fe-41dd-8980-d66518f24542 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:04.738592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:04.739321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:04.739686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:04.740138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] PATH_INFO: `/v3/projects/40778fdd03a14789aa2a4ab73279bcd4` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:04.741379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40778fdd03a14789aa2a4ab73279bcd4)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:04.749495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:04.801985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40778fdd03a14789aa2a4ab73279bcd4', 'request_id': 'req-1bbd66e9-7737-401c-acbd-e8f58cf41b88'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.811477 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40778fdd03a14789aa2a4ab73279bcd4', 'request_id': 'req-1bbd66e9-7737-401c-acbd-e8f58cf41b88'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.818192 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40778fdd03a14789aa2a4ab73279bcd4', 'request_id': 'req-1bbd66e9-7737-401c-acbd-e8f58cf41b88'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.829448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] The token cache is being invalidate because project 40778fdd03a14789aa2a4ab73279bcd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:04.829765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.830433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.832211 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1293/2616] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:04 2022] DELETE /identity/v3/projects/40778fdd03a14789aa2a4ab73279bcd4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:04.836274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:04.846099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e808-98ba-4c1b-b387-9183b6baf9d8 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:04.903350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:04.904207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:04.904499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:04.904784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] PATH_INFO: `/v3/users/60691fbfedb14fd9a177958f91acca35` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:04.905942 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=60691fbfedb14fd9a177958f91acca35)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:04.907929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:04.942716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:04.956072 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60691fbfedb14fd9a177958f91acca35'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.962868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60691fbfedb14fd9a177958f91acca35'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.963534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60691fbfedb14fd9a177958f91acca35'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.975378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60691fbfedb14fd9a177958f91acca35'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.982512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60691fbfedb14fd9a177958f91acca35'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:04.988365 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1324/2617] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:04 2022] DELETE /identity/v3/users/60691fbfedb14fd9a177958f91acca35 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:05.256968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.259089 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:05.273593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd66e9-7737-401c-acbd-e8f58cf41b88 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.279908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.281501 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:05.330117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:05.342337 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.343419 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.343831 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.344600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] PATH_INFO: `/v3/projects/8f7efb81b27d49eba34ecdf23032ee66` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.345802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7efb81b27d49eba34ecdf23032ee66)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.347745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.355681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4fc858-275f-4ae4-958a-af7580790aaa admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.361797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.362476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.362755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.363025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] PATH_INFO: `/v3/users/3abea053f9374240ab9381b91eb9a1b4` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.364141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3abea053f9374240ab9381b91eb9a1b4)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.366069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.399098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7efb81b27d49eba34ecdf23032ee66', 'request_id': 'req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.407743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7efb81b27d49eba34ecdf23032ee66', 'request_id': 'req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.414537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7efb81b27d49eba34ecdf23032ee66', 'request_id': 'req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.418184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3abea053f9374240ab9381b91eb9a1b4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.426083 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] The token cache is being invalidate because project 8f7efb81b27d49eba34ecdf23032ee66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:05.426299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3abea053f9374240ab9381b91eb9a1b4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.426418 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.426979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3abea053f9374240ab9381b91eb9a1b4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.427102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5e4e7b9a-52a2-42cc-b49d-a79630e996e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.428605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1294/2618] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:05 2022] DELETE /identity/v3/projects/8f7efb81b27d49eba34ecdf23032ee66 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:05.433404 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9364d-2975-467c-9610-7f635bc9af7b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.433630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9364d-2975-467c-9610-7f635bc9af7b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.433925 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9364d-2975-467c-9610-7f635bc9af7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.443673 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3abea053f9374240ab9381b91eb9a1b4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.452977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-96fee73e-d8f6-45d3-a1c0-7e4447d28ce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3abea053f9374240ab9381b91eb9a1b4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:05.454432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4aa9364d-2975-467c-9610-7f635bc9af7b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:05.455625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4aa9364d-2975-467c-9610-7f635bc9af7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:05.459388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1325/2619] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:05 2022] DELETE /identity/v3/users/3abea053f9374240ab9381b91eb9a1b4 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:05.463894 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.464210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.464649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.484337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:05.485557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:05.509791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:05.515389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1295/2620] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:05.524529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.524894 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.525166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.544849 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:05.546076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:05.550355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1326/2621] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:05.554265 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1296/2622] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:05.558377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.564534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.566064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:05.568784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9169eb4-3594-4da0-9857-c903170b5188 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.573362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.573991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.574270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.574539 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.575337 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:05.576317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.577925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.590306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1327/2623] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:05.594451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.604374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb2037-40a6-4a41-a3ca-297fef29fc95 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.609266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.609886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.610176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.610455 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.611084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.612974 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.623785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce210a1-d19f-453b-ab17-c09ccca6cfa6 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.627751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.628357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.628765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.629408 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.639580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.641167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.645790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1328/2624] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:05 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:05.647777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.653268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1297/2625] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:05.717482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf7cec-d743-4917-a23b-7cbee585096b admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.722168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.722779 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.723065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.723437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.724007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.726197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.752343 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1329/2626] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:05 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:05.756728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.767731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e05e0-f89e-48ab-9464-9333dcfcdce9 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.772817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.773431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.773729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.774036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.774690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.776423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.791190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1298/2627] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:05.792929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.802991 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6cfdf-bc03-429c-98f1-292ef558edf8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.808895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e6416-3092-4f55-b618-9883d1373351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.810465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6416-3092-4f55-b618-9883d1373351 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.810853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6416-3092-4f55-b618-9883d1373351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.811128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e6416-3092-4f55-b618-9883d1373351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.811783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6416-3092-4f55-b618-9883d1373351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.813698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e6416-3092-4f55-b618-9883d1373351 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.824367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1330/2628] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:05.832144 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:05.842961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45e64a2-05a8-4fb9-9837-c3a73fc9871c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:05.848118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:05.848783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.849073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.849357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] PATH_INFO: `/v3/projects/a1ce0b5934cb41e5a320beefad8d8bae/users/f9f94fc19db54f33b93cadbe47717153/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.852785 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:05.868524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1ce0b5934cb41e5a320beefad8d8bae, user_id=f9f94fc19db54f33b93cadbe47717153, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:05.871430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:05.885663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1299/2629] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:05 2022] PUT /identity/v3/projects/a1ce0b5934cb41e5a320beefad8d8bae/users/f9f94fc19db54f33b93cadbe47717153/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:05.897522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:05.898192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:05.898548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:05.932638 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] MFA Rules not processed for user `f9f94fc19db54f33b93cadbe47717153`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:05.933935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.001039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1331/2630] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:06.005617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.036373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.038047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.043648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:06.077507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bce36-6909-45f7-ad6f-1dab684c3d39 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.082644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.083256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.083541 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.083827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.084493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.086507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.111902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fb987-b6de-4c7d-8f89-0237b6ce81ea None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.114424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1300/2631] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:06 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:06.116599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.117247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.117842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.118125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] PATH_INFO: `/v3/projects/64e043faead14932a88ffd01e7543cee` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.118555 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.119270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e043faead14932a88ffd01e7543cee)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.121312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.184265 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e043faead14932a88ffd01e7543cee', 'request_id': 'req-aefa1dd6-300b-4649-acc1-b7c675d2721e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.189871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1d652-9829-403a-8255-4e12e76b48f2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.193688 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e043faead14932a88ffd01e7543cee', 'request_id': 'req-aefa1dd6-300b-4649-acc1-b7c675d2721e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.200270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e043faead14932a88ffd01e7543cee', 'request_id': 'req-aefa1dd6-300b-4649-acc1-b7c675d2721e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.217402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] The token cache is being invalidate because project 64e043faead14932a88ffd01e7543cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:06.218035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.218951 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.223560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1332/2632] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:06 2022] DELETE /identity/v3/projects/64e043faead14932a88ffd01e7543cee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:06.225308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.227134 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.261231 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.261911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.261911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.261911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.262881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.265189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.288306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1301/2633] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:06 2022] POST /identity/v3/users => generated 291 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:06.292601 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.294362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.311166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa1dd6-300b-4649-acc1-b7c675d2721e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.319071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527562ce-713e-4a57-850c-cdabc99f6072 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.320593 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.321903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.322710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.323351 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] PATH_INFO: `/v3/users/65fc98511d404c7e944852ccc9fc32b0` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.324170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.324775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.325064 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.325343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.326475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65fc98511d404c7e944852ccc9fc32b0)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.326607 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.328205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.329171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.330043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:06.343481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1302/2634] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:06.347713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.361031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1fd2e-9a2a-4010-8008-ed2c861e534f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.368576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.369343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.369343 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.370173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] PATH_INFO: `/v3/projects/9dc9def557764607ae51bd005aa84e4a/users/73c7c36cb8234481b6ff1432beaa6f16/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.392446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:06.402055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc9def557764607ae51bd005aa84e4a, user_id=73c7c36cb8234481b6ff1432beaa6f16, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.404987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65fc98511d404c7e944852ccc9fc32b0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.405454 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.415039 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65fc98511d404c7e944852ccc9fc32b0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.415947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65fc98511d404c7e944852ccc9fc32b0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.422535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1303/2635] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:06 2022] PUT /identity/v3/projects/9dc9def557764607ae51bd005aa84e4a/users/73c7c36cb8234481b6ff1432beaa6f16/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:06.426504 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.432865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65fc98511d404c7e944852ccc9fc32b0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.443251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65fc98511d404c7e944852ccc9fc32b0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:06.451634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1333/2636] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:06 2022] DELETE /identity/v3/users/65fc98511d404c7e944852ccc9fc32b0 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:06.506236 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb260079-14e3-4ea2-882f-28c65da074d2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.569215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1319c7-9e0b-4d76-8f04-8876236a62aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.569998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1319c7-9e0b-4d76-8f04-8876236a62aa admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.570384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1319c7-9e0b-4d76-8f04-8876236a62aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.570671 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1319c7-9e0b-4d76-8f04-8876236a62aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.571326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1319c7-9e0b-4d76-8f04-8876236a62aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.572949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1319c7-9e0b-4d76-8f04-8876236a62aa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.584232 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1304/2637] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:06.588717 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.590472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.604131 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5208ffb-ad1d-47bf-94b3-ec0bb20c3844 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.609512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.610395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.610724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.610998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] PATH_INFO: `/v3/projects/9dc9def557764607ae51bd005aa84e4a/users/73c7c36cb8234481b6ff1432beaa6f16/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.613642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc9def557764607ae51bd005aa84e4a, user_id=73c7c36cb8234481b6ff1432beaa6f16, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.616340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.628013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1334/2638] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:06 2022] PUT /identity/v3/projects/9dc9def557764607ae51bd005aa84e4a/users/73c7c36cb8234481b6ff1432beaa6f16/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:06.638494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.638745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.639164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.669203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] MFA Rules not processed for user `73c7c36cb8234481b6ff1432beaa6f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:06.670987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.740275 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:06.750005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1305/2639] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:06 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:06.758104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.759822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.815524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.817416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.824797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b053f2-34b4-4cd2-b3a3-111f570f66b5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.829110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.829750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.830041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.830352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.840099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.841958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:06.851902 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1335/2640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:06.903257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:06.905504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.922683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfa77a-d4ea-4caa-ae9d-24cbcfb0e985 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.929207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.929929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.930160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.930432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.932196 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:06.946529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec30095-ee7a-4da7-af84-bf42e3512693 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:06.953214 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:06.954247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:06.954731 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:06.955189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] PATH_INFO: `/v3/projects/6cdc3dee82454981ab655d79ea9bcf2e` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:06.956826 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdc3dee82454981ab655d79ea9bcf2e)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:06.958905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.001851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.003173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde9ee28-f909-4c01-ab17-7f2d4384ad89 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.012964 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1336/2641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:07.016509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdc3dee82454981ab655d79ea9bcf2e', 'request_id': 'req-36abffae-5131-46f0-9c58-247aa8c14b4b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:07.025837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdc3dee82454981ab655d79ea9bcf2e', 'request_id': 'req-36abffae-5131-46f0-9c58-247aa8c14b4b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:07.034610 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdc3dee82454981ab655d79ea9bcf2e', 'request_id': 'req-36abffae-5131-46f0-9c58-247aa8c14b4b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:07.046679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] The token cache is being invalidate because project 6cdc3dee82454981ab655d79ea9bcf2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:07.046969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:07.047651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-36abffae-5131-46f0-9c58-247aa8c14b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:07.049099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1306/2642] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:06 2022] DELETE /identity/v3/projects/6cdc3dee82454981ab655d79ea9bcf2e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:07.054983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.055273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.055549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.077369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:07.078527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:07.113923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:07.142279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1337/2643] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:07.150946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.151262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.151549 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.173530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:07.174836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:07.183385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1307/2644] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:07.188299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.198044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b8c5e-75b3-433a-b365-8b6ab41364da None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.203407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.204014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.204300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.204578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.205228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:07.205537 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.207167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.223811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1338/2645] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:07.225005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.235114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe6d7-424c-4f0a-9acf-78267d224e30 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.240186 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.240859 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.241143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.241411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.242075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.244122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.274877 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1308/2646] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:07.278891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.290010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb311e-5ccc-4132-beff-532595076156 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.354061 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.355437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.357677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.357677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.357677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.359925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.383300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1339/2647] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:07.387499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.398377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca50915-e887-4f80-b29d-2227212ac81e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.403114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.403750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.404036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.404332 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.404952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.406591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.416969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1309/2648] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:07.421468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.431578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c28da0-0e83-49f6-bef9-40fe00d2a588 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.436926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a72c0-7069-4f47-b22a-53a6f8f09038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.437525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a72c0-7069-4f47-b22a-53a6f8f09038 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.437847 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a72c0-7069-4f47-b22a-53a6f8f09038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.438130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a72c0-7069-4f47-b22a-53a6f8f09038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.438808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a72c0-7069-4f47-b22a-53a6f8f09038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.440393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a72c0-7069-4f47-b22a-53a6f8f09038 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.451050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1340/2649] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:07.455307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.465315 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9237c79-945e-4d58-8d4e-b050c16d3a85 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.470164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.470807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.471093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.471373 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] PATH_INFO: `/v3/projects/322314fce491433aabbfc81de42d32be/users/0308b55110144bd9924da5abc38ea54c/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.486681 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=322314fce491433aabbfc81de42d32be, user_id=0308b55110144bd9924da5abc38ea54c, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.489328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.502650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1310/2650] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:07 2022] PUT /identity/v3/projects/322314fce491433aabbfc81de42d32be/users/0308b55110144bd9924da5abc38ea54c/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:07.513802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.514093 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.514367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.541691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] MFA Rules not processed for user `0308b55110144bd9924da5abc38ea54c`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:07.542946 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:07.606602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1341/2651] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:07.611489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.641669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:07.675951 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54269-5272-40a6-8407-87e116d43455 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.680595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.681218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.681501 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.681804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.682445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.684393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.712705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1311/2652] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:07.717212 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.728198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ca710f-c602-4271-9d4e-7bab1763d59e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.761218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:07.786988 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.787596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.787882 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.788157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.789057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.791029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.812583 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1342/2653] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:07 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:07.816679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.827269 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac20b1-934e-4c65-82e2-5f5cea1f48dc admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.831997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.832591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.832878 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.833155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.833871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.835472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.846818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1312/2654] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:07.850950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.861582 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7f46-e32c-4ac0-9178-c5f0e83b67c5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.866442 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.867124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.867407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.867712 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] PATH_INFO: `/v3/projects/6ebca244b1644c1baf5dd57df740bfc0/users/9aeecd0a8128475e86611498e178a799/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.882905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebca244b1644c1baf5dd57df740bfc0, user_id=9aeecd0a8128475e86611498e178a799, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.885552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.898451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1343/2655] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:07 2022] PUT /identity/v3/projects/6ebca244b1644c1baf5dd57df740bfc0/users/9aeecd0a8128475e86611498e178a799/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:07.902389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:07.913046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b92876-788e-4a98-a7e6-8b44e66bdac7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:07.971518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c6131b-fdfc-47d8-bcc2-5bccd9d63052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:07.972114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6131b-fdfc-47d8-bcc2-5bccd9d63052 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:07.972400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6131b-fdfc-47d8-bcc2-5bccd9d63052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:07.972680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c6131b-fdfc-47d8-bcc2-5bccd9d63052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:07.973328 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6131b-fdfc-47d8-bcc2-5bccd9d63052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:07.974959 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c6131b-fdfc-47d8-bcc2-5bccd9d63052 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:07.985440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1313/2656] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:07.989755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:08.000318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163855df-7344-432c-84f7-e8b77647fe75 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:08.004876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:08.005513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:08.005823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:08.006094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] PATH_INFO: `/v3/projects/6ebca244b1644c1baf5dd57df740bfc0/users/9aeecd0a8128475e86611498e178a799/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:08.007981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebca244b1644c1baf5dd57df740bfc0, user_id=9aeecd0a8128475e86611498e178a799, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:08.010662 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:08.020802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1344/2657] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:07 2022] PUT /identity/v3/projects/6ebca244b1644c1baf5dd57df740bfc0/users/9aeecd0a8128475e86611498e178a799/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:08.032247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:08.032540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:08.032818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:08.063125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] MFA Rules not processed for user `9aeecd0a8128475e86611498e178a799`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:08.064334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:08.136150 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1314/2658] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:08.149438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:08.151947 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:08.214388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5cc39-6ee5-420b-bb6c-2a4c94bd3df0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:08.218775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe1f39-ac30-4941-bd73-0aff67a76408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:08.219431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1f39-ac30-4941-bd73-0aff67a76408 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:08.219732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1f39-ac30-4941-bd73-0aff67a76408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:08.219984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe1f39-ac30-4941-bd73-0aff67a76408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:08.282746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe1f39-ac30-4941-bd73-0aff67a76408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:08.284201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe1f39-ac30-4941-bd73-0aff67a76408 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:08.294929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1345/2659] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:10.543436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:10.545617 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:10.573684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:10.616870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221c832-5418-4790-ad6b-a1c660f54449 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:10.621465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:10.622128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:10.622415 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:10.623669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] PATH_INFO: `/v3/users/f9f94fc19db54f33b93cadbe47717153` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:10.624783 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9f94fc19db54f33b93cadbe47717153)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:10.626786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:10.673346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9f94fc19db54f33b93cadbe47717153'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.680372 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9f94fc19db54f33b93cadbe47717153'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.681196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9f94fc19db54f33b93cadbe47717153'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.689302 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9f94fc19db54f33b93cadbe47717153'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.689971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9f94fc19db54f33b93cadbe47717153'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.708000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1315/2660] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:10 2022] DELETE /identity/v3/users/f9f94fc19db54f33b93cadbe47717153 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:10.712465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:10.712941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:10.713156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:10.732733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:10.733981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:10.772829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:10.795223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1346/2661] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:10.804588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:10.806052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:10.865170 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76664d5-27ad-48e1-8fcc-84f1fa070ff6 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:10.869106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac056eb0-66be-466c-8239-0505d0e7beff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:10.869760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056eb0-66be-466c-8239-0505d0e7beff service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:10.870052 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056eb0-66be-466c-8239-0505d0e7beff service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:10.870329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac056eb0-66be-466c-8239-0505d0e7beff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:10.880962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac056eb0-66be-466c-8239-0505d0e7beff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:10.882487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac056eb0-66be-466c-8239-0505d0e7beff service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:10.882780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:10.884155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:10.893031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1316/2662] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:10.897297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdeda7-efd0-43de-ae38-c71d7076cd7e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:10.901945 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:10.902628 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:10.903535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:10.903879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] PATH_INFO: `/v3/users/0308b55110144bd9924da5abc38ea54c` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:10.905364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=0308b55110144bd9924da5abc38ea54c)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:10.907299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:10.958110 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0308b55110144bd9924da5abc38ea54c'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.965204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0308b55110144bd9924da5abc38ea54c'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.966015 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0308b55110144bd9924da5abc38ea54c'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.978423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0308b55110144bd9924da5abc38ea54c'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.986786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0308b55110144bd9924da5abc38ea54c'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:10.992949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1347/2663] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:10 2022] DELETE /identity/v3/users/0308b55110144bd9924da5abc38ea54c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:10.998344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:10.998635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:10.998909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:11.019571 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:11.020798 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:11.066123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:11.087487 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1317/2664] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:11.097530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:11.098950 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:11.158334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07fe885-d125-4b5d-b3ac-0a9872352bad admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:11.162509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:11.163157 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:11.163434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:11.163710 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:11.174315 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:11.175753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:11.176647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:11.178253 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:11.186461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1348/2665] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:11.195502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee37dd-82af-4e1b-8754-fcb57c5b43f7 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:11.201004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:11.201645 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:11.201963 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:11.202405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] PATH_INFO: `/v3/projects/a1ce0b5934cb41e5a320beefad8d8bae` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:11.203764 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1ce0b5934cb41e5a320beefad8d8bae)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:11.205750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:11.257739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1ce0b5934cb41e5a320beefad8d8bae', 'request_id': 'req-b2f36daf-7c63-41ca-b3fe-506905f83e6b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.266234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1ce0b5934cb41e5a320beefad8d8bae', 'request_id': 'req-b2f36daf-7c63-41ca-b3fe-506905f83e6b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.273594 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1ce0b5934cb41e5a320beefad8d8bae', 'request_id': 'req-b2f36daf-7c63-41ca-b3fe-506905f83e6b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.290750 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] The token cache is being invalidate because project a1ce0b5934cb41e5a320beefad8d8bae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:11.291098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.292118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.293749 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1318/2666] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:11 2022] DELETE /identity/v3/projects/a1ce0b5934cb41e5a320beefad8d8bae => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:11.297963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:11.307834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886997-57ae-4af7-ad4d-ecb5d8f6954d service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:11.381094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:11.396759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:11.397492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:11.397969 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:11.398377 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] PATH_INFO: `/v3/users/73c7c36cb8234481b6ff1432beaa6f16` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:11.399702 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c7c36cb8234481b6ff1432beaa6f16)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:11.401617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:11.458460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c7c36cb8234481b6ff1432beaa6f16'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.468626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c7c36cb8234481b6ff1432beaa6f16'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.469696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c7c36cb8234481b6ff1432beaa6f16'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.487342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c7c36cb8234481b6ff1432beaa6f16'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.497226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c7c36cb8234481b6ff1432beaa6f16'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.498072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:11.499542 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:11.505551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1349/2667] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:11 2022] DELETE /identity/v3/users/73c7c36cb8234481b6ff1432beaa6f16 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:11.512860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f36daf-7c63-41ca-b3fe-506905f83e6b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:11.597742 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:11.598940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:11.599348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:11.599502 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] PATH_INFO: `/v3/projects/322314fce491433aabbfc81de42d32be` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:11.601187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] RBAC: Authorizing `identity:delete_project(project_id=322314fce491433aabbfc81de42d32be)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:11.603299 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:11.672115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '322314fce491433aabbfc81de42d32be', 'request_id': 'req-bbf81ca1-33ff-42c7-96b4-538004ca444e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.682467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '322314fce491433aabbfc81de42d32be', 'request_id': 'req-bbf81ca1-33ff-42c7-96b4-538004ca444e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.693506 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '322314fce491433aabbfc81de42d32be', 'request_id': 'req-bbf81ca1-33ff-42c7-96b4-538004ca444e'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.702469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:11.707548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] The token cache is being invalidate because project 322314fce491433aabbfc81de42d32be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:11.708107 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.709271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.711084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1319/2668] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:11 2022] DELETE /identity/v3/projects/322314fce491433aabbfc81de42d32be => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:11.715090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:11.717427 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:11.735128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd4d781-31db-4cbf-b187-8ab32bcba638 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:11.805047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:11.805745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:11.806147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:11.806491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] PATH_INFO: `/v3/users/9aeecd0a8128475e86611498e178a799` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:11.807695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aeecd0a8128475e86611498e178a799)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:11.810097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:11.875627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aeecd0a8128475e86611498e178a799'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.887143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aeecd0a8128475e86611498e178a799'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.889081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aeecd0a8128475e86611498e178a799'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.911650 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aeecd0a8128475e86611498e178a799'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.916594 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:11.930613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9721e676-19be-4a7d-8dd0-57a4ceb7c14c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aeecd0a8128475e86611498e178a799'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:11.931677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:11.933184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:11.944054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1350/2669] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:11 2022] DELETE /identity/v3/users/9aeecd0a8128475e86611498e178a799 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:11.953417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf81ca1-33ff-42c7-96b4-538004ca444e admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.079772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.081551 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.083445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.083906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] PATH_INFO: `/v3/projects/9dc9def557764607ae51bd005aa84e4a` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.085842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc9def557764607ae51bd005aa84e4a)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.088647 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.168906 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc9def557764607ae51bd005aa84e4a', 'request_id': 'req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.187794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc9def557764607ae51bd005aa84e4a', 'request_id': 'req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.196760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc9def557764607ae51bd005aa84e4a', 'request_id': 'req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.210426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] The token cache is being invalidate because project 9dc9def557764607ae51bd005aa84e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:12.211084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.211851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.213680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1320/2670] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:11 2022] DELETE /identity/v3/projects/9dc9def557764607ae51bd005aa84e4a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:12.218995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151395df-19ed-47a9-8389-182ee31086ba None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.219285 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151395df-19ed-47a9-8389-182ee31086ba None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.219566 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151395df-19ed-47a9-8389-182ee31086ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.241683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-151395df-19ed-47a9-8389-182ee31086ba None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:12.243222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-151395df-19ed-47a9-8389-182ee31086ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.319696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1351/2671] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:12.327364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.328869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.329773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.331400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.332195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.344237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1db5b-fb5f-46f0-9e70-6be9e6b07e39 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.350692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.351349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.351625 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.351917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] PATH_INFO: `/v3/projects/6ebca244b1644c1baf5dd57df740bfc0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.353557 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebca244b1644c1baf5dd57df740bfc0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.355966 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.365318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:12.368284 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.383120 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1352/2672] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:12.384425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.397077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec81a3-c8ac-4715-8c63-c0235ebf1980 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.406602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.407224 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.408372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.408658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.409326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:12.409797 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.411318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.426844 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1353/2673] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:12.430759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.431215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebca244b1644c1baf5dd57df740bfc0', 'request_id': 'req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.440342 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebca244b1644c1baf5dd57df740bfc0', 'request_id': 'req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.443125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d94066-3ff6-4db1-9f9c-b69d96df1d5d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.447152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebca244b1644c1baf5dd57df740bfc0', 'request_id': 'req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.458658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] The token cache is being invalidate because project 6ebca244b1644c1baf5dd57df740bfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:12.458947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.459622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-789d6a1a-ab61-45a1-9f58-e4da7bccdec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:12.461207 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1321/2674] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:12 2022] DELETE /identity/v3/projects/6ebca244b1644c1baf5dd57df740bfc0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:12.465862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695ea2-73a5-43fa-a83b-ed6228bc0c57 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.466179 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695ea2-73a5-43fa-a83b-ed6228bc0c57 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.467403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99695ea2-73a5-43fa-a83b-ed6228bc0c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.494112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-99695ea2-73a5-43fa-a83b-ed6228bc0c57 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:12.495921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-99695ea2-73a5-43fa-a83b-ed6228bc0c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.503120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:12.512081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.513031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.513677 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.514014 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.514876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.516780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.549978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1354/2675] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:12.554557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.556482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.573836 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1322/2676] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:12.582650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.583070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.583440 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.609105 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:12.611949 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.661588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec37ebf-b603-4b02-b9b9-ece49cc93fbe admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.670333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.671104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.671453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.671795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.672511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.675379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.689035 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:12.704358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1323/2677] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:12.710565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1355/2678] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:12.710880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.712577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.720639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62af98-fcc2-4344-a645-a4a7db47cfa2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.724402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ad799-1710-4f48-b33e-1cd9366c4f2f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.727420 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.728270 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.728648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.728994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.729804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:12.730090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.730237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.730837 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.731187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.731538 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.732361 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.733071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.734127 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.744903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1356/2679] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:12.746763 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1324/2680] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:12.748984 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.751329 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.759144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac80a9b-f4b7-4930-8247-06db9cf998b2 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.763036 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1366063-31cb-4c26-9520-8196b4ed9da5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.764487 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.765094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.765381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.765658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.766345 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.767962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.769252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.769947 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.770291 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.770729 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.771334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.773469 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.781806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1357/2681] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:12.785414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.796966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446db55-f98d-49e9-95b1-d719e5982470 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.802485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1c8f0-f69d-4da9-b26e-4a2f2d282a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:12.803218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1c8f0-f69d-4da9-b26e-4a2f2d282a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.803509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1c8f0-f69d-4da9-b26e-4a2f2d282a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.803782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1c8f0-f69d-4da9-b26e-4a2f2d282a0c admin admin] PATH_INFO: `/v3/projects/0400e2f5b98f425a892facc99aacdec3/users/de736ceb10384a10a4d88c7b36f8a69c/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.808029 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1325/2682] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:12.812559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:12.821912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1c8f0-f69d-4da9-b26e-4a2f2d282a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0400e2f5b98f425a892facc99aacdec3, user_id=de736ceb10384a10a4d88c7b36f8a69c, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:12.827615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1c8f0-f69d-4da9-b26e-4a2f2d282a0c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:12.845980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1358/2683] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:12 2022] PUT /identity/v3/projects/0400e2f5b98f425a892facc99aacdec3/users/de736ceb10384a10a4d88c7b36f8a69c/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:12.856188 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:12.856829 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:12.857016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:12.883680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10703cd-7046-44ad-95a2-5984fc44b7d2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:12.901907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] MFA Rules not processed for user `de736ceb10384a10a4d88c7b36f8a69c`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:12.903896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:12.910775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:13.035789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.036642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.037118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.037494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.038286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.044115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.101436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1359/2684] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:13.105762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.127481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1326/2685] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:12 2022] POST /identity/v3/users => generated 287 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:13.132416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.134008 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61ff5f-73e2-484e-ac75-28b9262bb36c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.151627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.152263 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.157732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.158168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.158775 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.182660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277652a-56f6-4638-b660-2c5d10691eb7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.193112 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.196151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.197229 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.197544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.198485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.199664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.205345 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.235936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1327/2686] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:13.237254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.240356 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1360/2687] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:13 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:13.248318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.262760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2766542-e5cd-4f1e-9b7b-4378f8282f59 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.337279 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd85feb6-50f7-48e3-8a25-337e66ddf42c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.346546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.347348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.347711 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.347985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.348699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.352025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.352318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.353493 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.354010 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.354618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.356134 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.361499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.377775 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1328/2688] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:13.382835 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.383972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1361/2689] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:13 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:13.385246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.407877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f7dd85-701d-4368-9620-66ffdd6bd9cf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.409634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:13.419144 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.420366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.420871 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.421306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.422300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.423296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351fa58-6c6c-4d8e-8f9e-f265951e5674 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.424599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.429862 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd4c14-2d7f-49e4-a835-2a036fba42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.430753 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd4c14-2d7f-49e4-a835-2a036fba42bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.431109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd4c14-2d7f-49e4-a835-2a036fba42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.432327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd4c14-2d7f-49e4-a835-2a036fba42bc admin admin] PATH_INFO: `/v3/projects/9084e04e2f2341b4befb3b5c361b64f6/users/19e44a32c9b84242b3b2bc9b9e7ee975/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.439760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1362/2690] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:13.444185 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.462851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e46986-5d28-405d-97f5-f4d626c19cb8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.463410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd4c14-2d7f-49e4-a835-2a036fba42bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9084e04e2f2341b4befb3b5c361b64f6, user_id=19e44a32c9b84242b3b2bc9b9e7ee975, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.470639 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd4c14-2d7f-49e4-a835-2a036fba42bc admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.470887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.471674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.472095 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.472471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] PATH_INFO: `/v3/projects/37867645ccd842a8aeeace1f78282f32/users/70609deb90954231a57c5082a8c3ca16/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.491457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37867645ccd842a8aeeace1f78282f32, user_id=70609deb90954231a57c5082a8c3ca16, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.493635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1329/2691] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:13 2022] PUT /identity/v3/projects/9084e04e2f2341b4befb3b5c361b64f6/users/19e44a32c9b84242b3b2bc9b9e7ee975/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:13.498658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.498842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.499100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.499478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.515965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1363/2692] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:13 2022] PUT /identity/v3/projects/37867645ccd842a8aeeace1f78282f32/users/70609deb90954231a57c5082a8c3ca16/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:13.519745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.521888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:13.523117 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:13.600228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1330/2693] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:13.607869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.610388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:13.623359 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b24e35-5f41-423e-9fff-79b97f900639 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.634273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:13.635033 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.636326 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.636806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.637245 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.639532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.642334 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.655651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1364/2694] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:13.662613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.675453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4f941-fddd-419f-8018-9de17f9e81af admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.682603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d32ec-61c3-4ef6-b42b-f35b6f43a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.683609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d32ec-61c3-4ef6-b42b-f35b6f43a748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.683981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d32ec-61c3-4ef6-b42b-f35b6f43a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.684863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ebeb99-0ba0-47c6-87bb-8b1dd45dea3c None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:13.685801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d32ec-61c3-4ef6-b42b-f35b6f43a748 admin admin] PATH_INFO: `/v3/projects/37867645ccd842a8aeeace1f78282f32/users/70609deb90954231a57c5082a8c3ca16/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.688310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d32ec-61c3-4ef6-b42b-f35b6f43a748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37867645ccd842a8aeeace1f78282f32, user_id=70609deb90954231a57c5082a8c3ca16, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.690711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:13.691215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d32ec-61c3-4ef6-b42b-f35b6f43a748 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.691591 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.691942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.692321 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.702457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1365/2695] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:13 2022] PUT /identity/v3/projects/37867645ccd842a8aeeace1f78282f32/users/70609deb90954231a57c5082a8c3ca16/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:13.704772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:13.706392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:13.713648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544458a1-90d0-4626-8618-b2b8c0b8689d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:13.713972 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544458a1-90d0-4626-8618-b2b8c0b8689d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:13.714249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544458a1-90d0-4626-8618-b2b8c0b8689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:13.718582 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1331/2696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:13.749949 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-544458a1-90d0-4626-8618-b2b8c0b8689d None None] MFA Rules not processed for user `70609deb90954231a57c5082a8c3ca16`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:13.751634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-544458a1-90d0-4626-8618-b2b8c0b8689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:13.853899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1366/2697] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:13 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:13.864101 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:13.867127 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:13.958225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4760900-5d8b-42aa-9d22-ce7c063562fc service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:14.015361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:14.016293 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:14.016638 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:14.016981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:14.028047 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:14.029825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:14.041180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1332/2698] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:14.585238 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:14.585777 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:14.586425 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:14.633997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] MFA Rules not processed for user `19e44a32c9b84242b3b2bc9b9e7ee975`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:14.636364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:14.645513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:14.705535 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:14.780037 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db90af0-e130-45a8-94eb-bb355c5645f0 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:14.787182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:14.787832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:14.788108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:14.788377 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] PATH_INFO: `/v3/users/de736ceb10384a10a4d88c7b36f8a69c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:14.789979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de736ceb10384a10a4d88c7b36f8a69c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:14.792117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1367/2699] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:14.793000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:14.796441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:14.823422 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:14.853887 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de736ceb10384a10a4d88c7b36f8a69c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:14.862586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de736ceb10384a10a4d88c7b36f8a69c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:14.863953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de736ceb10384a10a4d88c7b36f8a69c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:14.873326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de736ceb10384a10a4d88c7b36f8a69c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:14.873861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de736ceb10384a10a4d88c7b36f8a69c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:14.877155 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347f48a-bba4-4e3f-b5ec-6a318763f399 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:14.881125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:14.881869 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:14.882151 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:14.882434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:14.884252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:14.897109 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1333/2700] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:14 2022] DELETE /identity/v3/users/de736ceb10384a10a4d88c7b36f8a69c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:14.900803 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:14.902281 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:14.967823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:14.969437 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae2ab4f-02fe-4efc-8c44-c8ac7ff62943 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:14.976217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec2a0d-fe2c-4014-9267-dfe0132a94b4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:14.979990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:14.980476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1368/2701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:14.980825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:14.981178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:14.981595 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:14.981744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:14.983183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:14.983589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:14.984050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:15.008109 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:15.010225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:15.081451 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:15.084488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:15.109606 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1334/2702] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:15.117911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1369/2703] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:15.130432 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:15.131984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:15.219424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc8b8e-c190-42a0-b4ff-cab9e367eaf9 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:15.224215 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:15.225257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:15.225257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:15.225450 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:15.236517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:15.243540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:15.245407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:15.260508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1335/2704] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:15.598908 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:15.602325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:15.633213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7f225-bad0-4e83-a02a-93c388a0f256 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:15.651223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:15.653355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:15.653355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:15.653355 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] PATH_INFO: `/v3/projects/0400e2f5b98f425a892facc99aacdec3` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:15.653910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0400e2f5b98f425a892facc99aacdec3)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:15.656424 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:15.668907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=100 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:15.713360 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0400e2f5b98f425a892facc99aacdec3', 'request_id': 'req-9145e044-e5db-450e-b325-dd8245e401fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.722090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0400e2f5b98f425a892facc99aacdec3', 'request_id': 'req-9145e044-e5db-450e-b325-dd8245e401fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.729433 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0400e2f5b98f425a892facc99aacdec3', 'request_id': 'req-9145e044-e5db-450e-b325-dd8245e401fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.743889 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] The token cache is being invalidate because project 0400e2f5b98f425a892facc99aacdec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:15.744190 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.744873 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.746448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1370/2705] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:15 2022] DELETE /identity/v3/projects/0400e2f5b98f425a892facc99aacdec3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:15.751362 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:15.762123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3410d6-b118-4885-8b40-a6fb4af076ee service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:15.829130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:15.829804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:15.830085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:15.830358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] PATH_INFO: `/v3/users/70609deb90954231a57c5082a8c3ca16` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:15.831515 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70609deb90954231a57c5082a8c3ca16)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:15.833509 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:15.885834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70609deb90954231a57c5082a8c3ca16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.893453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70609deb90954231a57c5082a8c3ca16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.894224 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70609deb90954231a57c5082a8c3ca16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.902187 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70609deb90954231a57c5082a8c3ca16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.903306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c71db40-ed21-473f-ab0f-5ee3975713b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70609deb90954231a57c5082a8c3ca16'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:15.924381 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1336/2706] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:15 2022] DELETE /identity/v3/users/70609deb90954231a57c5082a8c3ca16 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:16.201378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.203503 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:16.218119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145e044-e5db-450e-b325-dd8245e401fe admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.281944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.282588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.282877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.283140 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] PATH_INFO: `/v3/projects/37867645ccd842a8aeeace1f78282f32` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.284262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] RBAC: Authorizing `identity:delete_project(project_id=37867645ccd842a8aeeace1f78282f32)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.286249 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.343549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37867645ccd842a8aeeace1f78282f32', 'request_id': 'req-4d0defbb-ff7b-422a-8405-757adc33534d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:16.353796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37867645ccd842a8aeeace1f78282f32', 'request_id': 'req-4d0defbb-ff7b-422a-8405-757adc33534d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:16.364391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37867645ccd842a8aeeace1f78282f32', 'request_id': 'req-4d0defbb-ff7b-422a-8405-757adc33534d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:16.384122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] The token cache is being invalidate because project 37867645ccd842a8aeeace1f78282f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:16.384261 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:16.385223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-4d0defbb-ff7b-422a-8405-757adc33534d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:16.387186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1371/2707] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:16 2022] DELETE /identity/v3/projects/37867645ccd842a8aeeace1f78282f32 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:16.394677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.395217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.395563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.423022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:16.424456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:16.502445 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1337/2708] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:16.511128 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.511792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.512431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.540175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:16.541640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:16.562228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1372/2709] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:16.562533 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.574180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105df8e-1a07-430d-868e-1ee61a17a522 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.580876 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.582660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.583059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.583926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.584697 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:16.585567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.590481 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df07fc-d911-4195-8bf1-41e9b795c355 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.603767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:16.608237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1338/2710] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:16.612309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.613600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.613985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.615334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.623534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a9f55-1896-460a-985a-a4ad434f0a9d None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.629411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.630105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.630524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.630865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.631515 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.633690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.646816 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] MFA Rules not processed for user `19e44a32c9b84242b3b2bc9b9e7ee975`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:16.649489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:16.661348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:16.669523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1373/2711] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:16 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:16.674189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.729751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1339/2712] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:16.748735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aae41-12b5-4414-a37f-d05d2265cd63 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.754444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.755270 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.755755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.756034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.756693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.758623 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.782435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1374/2713] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:16 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:16.786655 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.798819 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32a5592-3286-446e-abc7-e195d16c4bdb None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.803973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.804585 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.805026 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.805478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.806169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.807782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.819195 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1340/2714] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:16.823186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.834171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e10b7-3260-4ddf-bbeb-1dde914632e5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.839293 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca84b6-88d8-4e68-927c-e4efaf6bc7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.839903 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca84b6-88d8-4e68-927c-e4efaf6bc7ac admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.840184 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca84b6-88d8-4e68-927c-e4efaf6bc7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.840460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca84b6-88d8-4e68-927c-e4efaf6bc7ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.841106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca84b6-88d8-4e68-927c-e4efaf6bc7ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.842963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca84b6-88d8-4e68-927c-e4efaf6bc7ac admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.853957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1375/2715] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:16.858194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:16.868576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25c421-7d29-4bb5-aa23-3141f8ac16b5 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:16.874057 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:16.874718 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.875003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.875285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] PATH_INFO: `/v3/projects/4cbda189c22944f9a55b1da94f51affb/users/2955e7aacf1142c9802951680e68f159/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.892974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbda189c22944f9a55b1da94f51affb, user_id=2955e7aacf1142c9802951680e68f159, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:16.895940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:16.910093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1341/2716] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:16 2022] PUT /identity/v3/projects/4cbda189c22944f9a55b1da94f51affb/users/2955e7aacf1142c9802951680e68f159/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:16.921087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:16.921289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:16.921602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:16.952324 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] MFA Rules not processed for user `2955e7aacf1142c9802951680e68f159`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:16.953759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:17.021421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1376/2717] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:17.025823 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.094770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31a40c9-80cc-4fe4-ad3b-a1048df21b6c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.099787 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.100392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.100672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.100998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.101673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.103596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.110963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.112469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:17.134679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1342/2718] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:17 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:17.138618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.187117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46117a2a-fa86-429c-abd3-b493c9320d53 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.216191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:17.221463 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:17.226812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806eafa-7c14-47be-8ccb-dcb41d49473f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.233589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.234132 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.234517 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.234799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.235635 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.237776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.267164 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1343/2719] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:17 2022] POST /identity/v3/users => generated 296 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:17.268621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.272465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.272910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:17.273172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.273595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.273970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.276511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:17.309124 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.311029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.326597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1377/2720] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:17.344253 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.371453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abab463-9cec-4d20-b698-076be7a58955 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.391761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678a2b9-d2bb-4fcc-8f9b-58f737aec730 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.392030 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.393753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.394476 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.395247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.397260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.399917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.401335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.401472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.401588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.401588 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.403335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:17.421227 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.422869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.425830 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1378/2721] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:17.438467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.445530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1344/2722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:17.460435 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d1f3e1-8abd-4887-ba72-22504868a538 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.466927 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.469021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.469429 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.469856 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] PATH_INFO: `/v3/projects/d841caa4929244cc881c960ecfb3f088/users/2a87c43c4bd9414d99194e56229de3f5/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.492822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d841caa4929244cc881c960ecfb3f088, user_id=2a87c43c4bd9414d99194e56229de3f5, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.499793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.517412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1379/2723] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:17 2022] PUT /identity/v3/projects/d841caa4929244cc881c960ecfb3f088/users/2a87c43c4bd9414d99194e56229de3f5/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:17.521068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.533640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6ff586-6a0a-4ce0-b4d4-f5ef5da70dcb service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.624784 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a959da-10f1-4446-9207-5d432979c789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.626075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a959da-10f1-4446-9207-5d432979c789 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.626537 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a959da-10f1-4446-9207-5d432979c789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.626950 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a959da-10f1-4446-9207-5d432979c789 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.627746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a959da-10f1-4446-9207-5d432979c789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.629864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a959da-10f1-4446-9207-5d432979c789 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.648058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1345/2724] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:17.649105 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.671193 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c127c2-ccd6-46a4-a5c3-0851255bb1af admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.686692 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.687587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.689980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.690469 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] PATH_INFO: `/v3/projects/d841caa4929244cc881c960ecfb3f088/users/2a87c43c4bd9414d99194e56229de3f5/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.694691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d841caa4929244cc881c960ecfb3f088, user_id=2a87c43c4bd9414d99194e56229de3f5, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:17.697634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:17.766898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1380/2725] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:17 2022] PUT /identity/v3/projects/d841caa4929244cc881c960ecfb3f088/users/2a87c43c4bd9414d99194e56229de3f5/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:17.768417 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.768711 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.768993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.826269 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:17.834767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] MFA Rules not processed for user `2a87c43c4bd9414d99194e56229de3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:17.836190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:17.950524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:17.980156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909b73a-780f-4d3d-bd7f-d484736485f1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:17.989158 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1346/2726] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:17.994931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:17.995750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:17.995838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:17.996133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:17.998578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:18.001634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:18.004202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:18.162008 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647164e6-f7d4-4403-9552-7cdfcb052a90 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:18.165466 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:18.166234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:18.166844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:18.166970 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:18.167123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:18.167394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:18.179979 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:18.181838 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:18.188201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1381/2727] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:18.206957 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1347/2728] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:18.336851 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:18.352321 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39bd7e9-66d6-4330-b8fe-069df3e082de service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:18.360577 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10b4d9-d677-4313-8d8d-d457e98a6305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:18.361229 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b4d9-d677-4313-8d8d-d457e98a6305 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:18.361551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b4d9-d677-4313-8d8d-d457e98a6305 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:18.361907 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10b4d9-d677-4313-8d8d-d457e98a6305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:18.438262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:18.516405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10b4d9-d677-4313-8d8d-d457e98a6305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:18.519274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b10b4d9-d677-4313-8d8d-d457e98a6305 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:18.536123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1382/2729] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:18.977011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:18.994596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb471e6a-52c1-4fda-aab2-340dcfc7de94 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:19.000012 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:19.000776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:19.001161 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:19.001680 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] PATH_INFO: `/v3/users/2955e7aacf1142c9802951680e68f159` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:19.002941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2955e7aacf1142c9802951680e68f159)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:19.004961 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:19.066384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2955e7aacf1142c9802951680e68f159'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:19.076657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2955e7aacf1142c9802951680e68f159'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:19.078272 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2955e7aacf1142c9802951680e68f159'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:19.096715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2955e7aacf1142c9802951680e68f159'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:19.099258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2955e7aacf1142c9802951680e68f159'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:19.121243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1348/2730] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:18 2022] DELETE /identity/v3/users/2955e7aacf1142c9802951680e68f159 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:19.126405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:19.127460 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:19.127935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:19.150456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:19.151714 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:19.243913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1383/2731] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:19.260324 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:19.263433 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:19.331360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65b97b-ce39-4285-97ce-c31d3352ce85 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:19.336304 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:19.336845 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:19.337128 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:19.337400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:19.349945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:19.351204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:19.372255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1349/2732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:20.025905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:20.028031 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:20.042667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fe8e19-0d14-4307-9471-9df2d9d5eb8e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:20.049528 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:20.050254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:20.050534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:20.050810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] PATH_INFO: `/v3/projects/4cbda189c22944f9a55b1da94f51affb` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:20.062647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbda189c22944f9a55b1da94f51affb)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:20.067111 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:20.130937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbda189c22944f9a55b1da94f51affb', 'request_id': 'req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.141316 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbda189c22944f9a55b1da94f51affb', 'request_id': 'req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.149835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbda189c22944f9a55b1da94f51affb', 'request_id': 'req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.164773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] The token cache is being invalidate because project 4cbda189c22944f9a55b1da94f51affb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:20.165121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.166047 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.168773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1384/2733] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:20 2022] DELETE /identity/v3/projects/4cbda189c22944f9a55b1da94f51affb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:20.173358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:20.183995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e0268-5867-44be-b3c7-4aaa8a52f82a service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:20.189774 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:20.256359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:20.257210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:20.257500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:20.257811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] PATH_INFO: `/v3/users/2a87c43c4bd9414d99194e56229de3f5` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:20.259059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a87c43c4bd9414d99194e56229de3f5)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:20.261240 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:20.321782 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a87c43c4bd9414d99194e56229de3f5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.333855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a87c43c4bd9414d99194e56229de3f5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.334776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a87c43c4bd9414d99194e56229de3f5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.345097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a87c43c4bd9414d99194e56229de3f5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.346116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d61f5cd7-e1db-47fa-8e75-1e314a308fd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a87c43c4bd9414d99194e56229de3f5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:20.373766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1350/2734] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:20 2022] DELETE /identity/v3/users/2a87c43c4bd9414d99194e56229de3f5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:21.290762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:21.292760 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:21.312769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fff53e-ea6f-4758-a97c-5fe5a2e73d01 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:21.438060 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:21.486160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:21.488032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:21.488602 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:21.488887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] PATH_INFO: `/v3/projects/d841caa4929244cc881c960ecfb3f088` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:21.491660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d841caa4929244cc881c960ecfb3f088)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:21.512699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:21.611769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd841caa4929244cc881c960ecfb3f088', 'request_id': 'req-f694f045-56c9-42ac-a0c5-ff57ab8401e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:21.625063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd841caa4929244cc881c960ecfb3f088', 'request_id': 'req-f694f045-56c9-42ac-a0c5-ff57ab8401e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:21.635125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd841caa4929244cc881c960ecfb3f088', 'request_id': 'req-f694f045-56c9-42ac-a0c5-ff57ab8401e1'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:21.651990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] The token cache is being invalidate because project d841caa4929244cc881c960ecfb3f088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:21.652369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:21.653073 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f694f045-56c9-42ac-a0c5-ff57ab8401e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:21.655235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1385/2735] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:21 2022] DELETE /identity/v3/projects/d841caa4929244cc881c960ecfb3f088 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:21.660108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:21.660605 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:21.660698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:21.685644 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:21.686919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:21.766361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1351/2736] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:21.768086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:21.768379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:21.768656 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:21.791509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:21.792843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:21.802153 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1386/2737] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:21.807323 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:21.820056 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c843a55e-552d-400e-b7c9-0b252e0a25d9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:21.825486 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:21.827156 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:21.827661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:21.833389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:21.834339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:21.835390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:21.837558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:21.866570 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1352/2738] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:21.867150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:21.879700 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99886a2e-1114-4b85-974d-55773a2466e8 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:21.884928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:21.885560 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:21.885958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:21.886237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:21.887141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:21.889732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:21.933695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1387/2739] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:21 2022] POST /identity/v3/projects => generated 361 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:21.934917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:21.966110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6962a429-5ebf-43cd-b505-78e17af74785 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:21.981084 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:22.036292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.037596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.037870 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.038260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.038864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.041077 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:22.063699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1353/2740] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:21 2022] POST /identity/v3/users => generated 281 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:22.067647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:22.081004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45d3e2-1ef6-4a78-be6d-46bd24b75766 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:22.087371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.088795 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.089086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.089367 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.090062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.092288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:22.106045 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1388/2741] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:22.108210 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:22.118277 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28206cf-7dee-46e6-a5ed-c883f7ff554d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:22.123090 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b61a5-b6e0-47fd-a3b6-fe8e859d6992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.123695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b61a5-b6e0-47fd-a3b6-fe8e859d6992 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.123985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b61a5-b6e0-47fd-a3b6-fe8e859d6992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.124260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b61a5-b6e0-47fd-a3b6-fe8e859d6992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.124914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b61a5-b6e0-47fd-a3b6-fe8e859d6992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.126673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b61a5-b6e0-47fd-a3b6-fe8e859d6992 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:22.139488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1354/2742] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:22.143684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:22.155407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37418d1-228e-4768-9535-ab2d4b861aa8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:22.160150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.160807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.161088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.161468 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] PATH_INFO: `/v3/projects/9ae1760b7e5643d1ae46da31066803d4/users/bfd3ae25cc0d481ab5bca7a1eecbb8a6/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.180502 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae1760b7e5643d1ae46da31066803d4, user_id=bfd3ae25cc0d481ab5bca7a1eecbb8a6, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.183262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:22.198548 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1389/2743] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:22 2022] PUT /identity/v3/projects/9ae1760b7e5643d1ae46da31066803d4/users/bfd3ae25cc0d481ab5bca7a1eecbb8a6/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:22.209727 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960358-4566-47d3-9e66-814ba083348d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.210050 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960358-4566-47d3-9e66-814ba083348d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.210289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a960358-4566-47d3-9e66-814ba083348d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.242070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1a960358-4566-47d3-9e66-814ba083348d None None] MFA Rules not processed for user `bfd3ae25cc0d481ab5bca7a1eecbb8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:22.244699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1a960358-4566-47d3-9e66-814ba083348d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:22.321351 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1355/2744] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:22.357423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:22.359448 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:22.422480 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2477f4-827f-4510-94e8-1e4063d06e3a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:22.426204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17273860-8fde-45b5-9938-3b191173a73d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.426833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273860-8fde-45b5-9938-3b191173a73d service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.427121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273860-8fde-45b5-9938-3b191173a73d service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.427405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17273860-8fde-45b5-9938-3b191173a73d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.437098 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17273860-8fde-45b5-9938-3b191173a73d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.438610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17273860-8fde-45b5-9938-3b191173a73d service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:22.448410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1390/2745] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:22.522246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960358-4566-47d3-9e66-814ba083348d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:22.587945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a960358-4566-47d3-9e66-814ba083348d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:22.595254 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.595999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.596359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.596715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] PATH_INFO: `/v3/users/bfd3ae25cc0d481ab5bca7a1eecbb8a6` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.598159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd3ae25cc0d481ab5bca7a1eecbb8a6)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.600294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:22.646308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:22.681677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd3ae25cc0d481ab5bca7a1eecbb8a6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:22.692499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd3ae25cc0d481ab5bca7a1eecbb8a6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:22.693344 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd3ae25cc0d481ab5bca7a1eecbb8a6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:22.706733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd3ae25cc0d481ab5bca7a1eecbb8a6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:22.708167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd3ae25cc0d481ab5bca7a1eecbb8a6'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:22.765657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1356/2746] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:22 2022] DELETE /identity/v3/users/bfd3ae25cc0d481ab5bca7a1eecbb8a6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:22.770209 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.770499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.770803 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.799378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:22.800607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:22.816787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:22.886802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1391/2747] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:22.898611 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:22.900290 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:22.973364 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211faa-65a9-4c4c-b8ad-98941a627c6c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:22.977387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ebb8b8-9d2b-4f2e-89fb-5ba3bb5b8964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:22.978080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb8b8-9d2b-4f2e-89fb-5ba3bb5b8964 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:22.978703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb8b8-9d2b-4f2e-89fb-5ba3bb5b8964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:22.978703 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ebb8b8-9d2b-4f2e-89fb-5ba3bb5b8964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:22.990133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb8b8-9d2b-4f2e-89fb-5ba3bb5b8964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:22.991642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ebb8b8-9d2b-4f2e-89fb-5ba3bb5b8964 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:23.004125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1357/2748] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:23.308158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:23.310850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:23.329595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f324aa-7129-40ae-a768-4a05dfc7b9d7 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:23.334342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:23.335050 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.335336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.335517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] PATH_INFO: `/v3/projects/9ae1760b7e5643d1ae46da31066803d4` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.336745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae1760b7e5643d1ae46da31066803d4)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:23.338810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:23.398989 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae1760b7e5643d1ae46da31066803d4', 'request_id': 'req-927b2019-bc7c-4367-bdb3-533f0ee162fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.408409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae1760b7e5643d1ae46da31066803d4', 'request_id': 'req-927b2019-bc7c-4367-bdb3-533f0ee162fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.416509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae1760b7e5643d1ae46da31066803d4', 'request_id': 'req-927b2019-bc7c-4367-bdb3-533f0ee162fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.429187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] The token cache is being invalidate because project 9ae1760b7e5643d1ae46da31066803d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:23.429444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.430295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-927b2019-bc7c-4367-bdb3-533f0ee162fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.432462 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1392/2749] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:23 2022] DELETE /identity/v3/projects/9ae1760b7e5643d1ae46da31066803d4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:23.439817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.441027 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.441322 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.463971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:23.465259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:23.549070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1358/2750] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:23.556399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.556683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.556955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.581016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:23.582373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:23.593753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1393/2751] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:23.596244 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:23.607641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314b5a4-eb19-467f-8f6f-d686fb8f7557 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:23.612840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:23.613613 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.614004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.614286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.614941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:23.615248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:23.616867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:23.631547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1359/2752] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:23.635909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:23.646987 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb618aa-dbd7-47ce-9bdd-c270db42103a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:23.653001 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:23.653622 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.653939 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.654787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.655607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:23.657497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:23.675353 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:23.680059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:23.694751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1394/2753] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:23 2022] POST /identity/v3/projects => generated 383 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:23.699017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:23.728946 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:23.784430 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352e86c-e4c0-4fd5-880d-5630ed94e9d7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:23.818348 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459d9ea-95b0-4c4c-a3df-59dba7b05381 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:23.823234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:23.824067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.824353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.824745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.825391 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:23.828228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:23.857633 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1395/2754] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:23 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:23.861186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:23.861186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:23.871801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:23.883016 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac259b-e88f-4525-b4c1-fa20eaa8d560 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:23.895400 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:23.896642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:23.897260 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:23.898671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] PATH_INFO: `/v3/users/66526665148e4f1792868ce8d0c449f4` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:23.900511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66526665148e4f1792868ce8d0c449f4)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:23.902823 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:23.975595 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66526665148e4f1792868ce8d0c449f4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.984352 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66526665148e4f1792868ce8d0c449f4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:23.985208 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66526665148e4f1792868ce8d0c449f4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.001271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66526665148e4f1792868ce8d0c449f4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.007778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.008801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.008801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.009035 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.011001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.014863 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66526665148e4f1792868ce8d0c449f4'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.026034 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1396/2755] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:23 2022] DELETE /identity/v3/users/66526665148e4f1792868ce8d0c449f4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:24.027806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.030079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.032857 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.034574 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.050580 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1360/2756] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:24.106826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb64df-3e1c-4cbf-bf83-cd3df6bac220 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.114464 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.115088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.115374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.115646 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.116298 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.117923 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.132122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1397/2757] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:24.133346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.144076 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1d7f5-60a1-4720-8db0-00f140ab4ba3 service placement] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.148556 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d37144-7f9e-4c44-b19a-8dca5f77627d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.149147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d37144-7f9e-4c44-b19a-8dca5f77627d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.149426 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d37144-7f9e-4c44-b19a-8dca5f77627d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.149695 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d37144-7f9e-4c44-b19a-8dca5f77627d admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.150392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d37144-7f9e-4c44-b19a-8dca5f77627d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.151969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d37144-7f9e-4c44-b19a-8dca5f77627d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.163198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1361/2758] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:24.167626 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.178789 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a585292-89d1-4550-9302-7fe30645667f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.185257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.186613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.186819 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.187101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] PATH_INFO: `/v3/projects/2764d5b5b0b14f20b142da3c7c9b638a/users/d8dfb91b9d3846a79368563f42278d7c/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.205225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2764d5b5b0b14f20b142da3c7c9b638a, user_id=d8dfb91b9d3846a79368563f42278d7c, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.207936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.223979 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1398/2759] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:24 2022] PUT /identity/v3/projects/2764d5b5b0b14f20b142da3c7c9b638a/users/d8dfb91b9d3846a79368563f42278d7c/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:24.235191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.235476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.236238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.270553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] MFA Rules not processed for user `d8dfb91b9d3846a79368563f42278d7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:24.271978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.311062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.312995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.364181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1362/2760] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:24.375921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.377519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.382536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:24.405546 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc3eaa-4e8d-47fa-a9c8-c0774ff2eba8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.410690 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.411320 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.411773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.412207 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] PATH_INFO: `/v3/projects/149deb9276324f678793539913830ebc` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.413801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149deb9276324f678793539913830ebc)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.416156 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.440130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:24.453699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce9ceb-7859-4b5a-aa3f-adde327e8e92 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.467783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149deb9276324f678793539913830ebc', 'request_id': 'req-21fa17b9-92f4-4da4-94b1-d796e5f99f52'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.476684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149deb9276324f678793539913830ebc', 'request_id': 'req-21fa17b9-92f4-4da4-94b1-d796e5f99f52'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.485508 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149deb9276324f678793539913830ebc', 'request_id': 'req-21fa17b9-92f4-4da4-94b1-d796e5f99f52'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.501752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] The token cache is being invalidate because project 149deb9276324f678793539913830ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:24.501752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.501752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-21fa17b9-92f4-4da4-94b1-d796e5f99f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:24.501752 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1399/2761] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:24 2022] DELETE /identity/v3/projects/149deb9276324f678793539913830ebc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:24.505975 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4553-0430-4c69-b0aa-d08b02a59b47 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.506366 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4553-0430-4c69-b0aa-d08b02a59b47 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.506745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4553-0430-4c69-b0aa-d08b02a59b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.512532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.513153 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.513464 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.513769 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.516629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.527011 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-3b0b4553-0430-4c69-b0aa-d08b02a59b47 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:24.528289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3b0b4553-0430-4c69-b0aa-d08b02a59b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.591614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.593694 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.595432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1400/2762] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:24.603032 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1363/2763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:24.604649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.604992 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.605271 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.626567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:24.627770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:24.635817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1401/2764] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:24.640620 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.651987 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5dc18-2df8-4cbf-9ccb-c6c8143275e4 service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.657360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.658007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.658289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.658563 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.659213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:24.659518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.661114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.673327 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1364/2765] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:24.677668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.687246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb564f-fd0f-4632-b995-c1205224bbf2 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.691838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.692447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.692724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.692994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.693664 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.695568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.724617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1402/2766] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:24.728915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.739480 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0c5bf-542f-4ac8-a435-8391eea15afa admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.804059 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.804705 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.804990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.805266 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.805972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.808068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.829505 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1365/2767] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:24 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:24.833849 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.853910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75599c90-4d8b-4298-83d4-b1ce113cfcaf admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.853910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.853910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.853910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.854413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.854413 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.854828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.866929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1403/2768] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:24.870805 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.881971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22883687-e506-4869-b89a-7970f3120888 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.887058 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61959ab1-53d3-41c5-a14d-997bb6e7a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.887776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959ab1-53d3-41c5-a14d-997bb6e7a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.887913 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959ab1-53d3-41c5-a14d-997bb6e7a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.888188 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61959ab1-53d3-41c5-a14d-997bb6e7a2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.889507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959ab1-53d3-41c5-a14d-997bb6e7a2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.891118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61959ab1-53d3-41c5-a14d-997bb6e7a2f7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.903203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1366/2769] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:24.910403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:24.927681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102df42-b1c4-40a8-ba77-49f16347096a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:24.932587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:24.933248 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.933525 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.933828 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] PATH_INFO: `/v3/projects/68db76d262a3486fb4f0c932cdf54158/users/f1b17d301a854c66b2cdd23b2787a366/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:24.951192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68db76d262a3486fb4f0c932cdf54158, user_id=f1b17d301a854c66b2cdd23b2787a366, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:24.954477 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:24.968415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1404/2770] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:24 2022] PUT /identity/v3/projects/68db76d262a3486fb4f0c932cdf54158/users/f1b17d301a854c66b2cdd23b2787a366/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:24.978916 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:24.979209 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:24.979513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.007405 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] MFA Rules not processed for user `f1b17d301a854c66b2cdd23b2787a366`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:25.008615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:25.016762 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:25.075658 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1367/2771] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:25.080300 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.099374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:25.151817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c741b07-91e0-47ca-8bf9-1e2ff9a24998 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.158281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.159000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.159325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.159603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.160240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.162152 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.196659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1405/2772] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:25 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:25.201303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.211779 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1433e-0f24-4fc2-a863-2867447ae11d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.272178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.272824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.273110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.273387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.274118 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.276031 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.300867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1368/2773] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:25 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:25.304818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.315206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b66495-79ec-4bac-86e6-117749f979af admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.319833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.320421 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.320704 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.320978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.321683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.323299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.334227 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1406/2774] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:25.338151 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.348981 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526c69f-92a0-44e9-ae44-f30461a6b975 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.353660 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.354326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.354608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.354884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] PATH_INFO: `/v3/projects/51c3f20487ef440a940b03b513989a9d/users/539d170d204f4af48b45d7805f9713eb/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.370234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c3f20487ef440a940b03b513989a9d, user_id=539d170d204f4af48b45d7805f9713eb, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.373022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.388230 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1369/2775] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:25 2022] PUT /identity/v3/projects/51c3f20487ef440a940b03b513989a9d/users/539d170d204f4af48b45d7805f9713eb/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:25.393932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.404044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c57b1-936c-4513-9a57-c6383a7ff6d9 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.459932 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678302d3-265f-4a9e-a76a-9494e0e25ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.460584 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302d3-265f-4a9e-a76a-9494e0e25ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.460739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302d3-265f-4a9e-a76a-9494e0e25ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.461018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678302d3-265f-4a9e-a76a-9494e0e25ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.461659 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678302d3-265f-4a9e-a76a-9494e0e25ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.463273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678302d3-265f-4a9e-a76a-9494e0e25ba1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.473747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1407/2776] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:25.477990 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.488905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f9ae0-ab0c-44b2-8084-6f3a6fe6518d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.493427 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.494095 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.494374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.494642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] PATH_INFO: `/v3/projects/51c3f20487ef440a940b03b513989a9d/users/539d170d204f4af48b45d7805f9713eb/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.496536 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c3f20487ef440a940b03b513989a9d, user_id=539d170d204f4af48b45d7805f9713eb, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.499860 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.515068 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1370/2777] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:25 2022] PUT /identity/v3/projects/51c3f20487ef440a940b03b513989a9d/users/539d170d204f4af48b45d7805f9713eb/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:25.526158 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.526453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.526729 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.556921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] MFA Rules not processed for user `539d170d204f4af48b45d7805f9713eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:25.558189 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:25.627980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1408/2778] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:25.640278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:25.642004 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:25.698532 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6dadc0-d2ac-4942-9be9-4d74329a5311 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:25.703191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eded02-19dc-4532-baf1-40eec271a1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:25.703799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eded02-19dc-4532-baf1-40eec271a1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:25.704078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eded02-19dc-4532-baf1-40eec271a1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:25.704348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eded02-19dc-4532-baf1-40eec271a1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:25.713260 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eded02-19dc-4532-baf1-40eec271a1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:25.714621 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eded02-19dc-4532-baf1-40eec271a1a2 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:25.723958 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1371/2779] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:26.138591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:26.152412 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:26.212259 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f31b83-b1ba-4256-97eb-a2a3fb571951 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:26.218533 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:26.219113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:26.219395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:26.219732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] PATH_INFO: `/v3/users/f1b17d301a854c66b2cdd23b2787a366` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:26.220800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1b17d301a854c66b2cdd23b2787a366)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:26.222759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:26.274980 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1b17d301a854c66b2cdd23b2787a366'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.283070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1b17d301a854c66b2cdd23b2787a366'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.283765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1b17d301a854c66b2cdd23b2787a366'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.297684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1b17d301a854c66b2cdd23b2787a366'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.307336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1b17d301a854c66b2cdd23b2787a366'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.318340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1409/2780] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:26 2022] DELETE /identity/v3/users/f1b17d301a854c66b2cdd23b2787a366 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:26.323025 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933250b-475c-43e6-930a-57878fd929dc None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:26.323499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933250b-475c-43e6-930a-57878fd929dc None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:26.323608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933250b-475c-43e6-930a-57878fd929dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:26.333093 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:26.347715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-7933250b-475c-43e6-930a-57878fd929dc None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:26.349313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7933250b-475c-43e6-930a-57878fd929dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:26.423436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1372/2781] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:26.433976 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:26.436040 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:26.499750 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974fe8-b44a-4dbe-8d98-d757b27f1cb1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:26.503436 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:26.504042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:26.504323 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:26.504598 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:26.513576 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:26.515764 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:26.525065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1410/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:26.800649 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933250b-475c-43e6-930a-57878fd929dc None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:26.802114 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-7933250b-475c-43e6-930a-57878fd929dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:26.814757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933250b-475c-43e6-930a-57878fd929dc None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:26.820184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:26.820820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:26.821131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:26.821403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] PATH_INFO: `/v3/projects/68db76d262a3486fb4f0c932cdf54158` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:26.822562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68db76d262a3486fb4f0c932cdf54158)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:26.824627 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:26.872484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68db76d262a3486fb4f0c932cdf54158', 'request_id': 'req-d9018748-252c-4238-bbcb-81bb583a5281'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.882073 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68db76d262a3486fb4f0c932cdf54158', 'request_id': 'req-d9018748-252c-4238-bbcb-81bb583a5281'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.888141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68db76d262a3486fb4f0c932cdf54158', 'request_id': 'req-d9018748-252c-4238-bbcb-81bb583a5281'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.898553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] The token cache is being invalidate because project 68db76d262a3486fb4f0c932cdf54158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:26.898837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.899462 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:26.900939 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1373/2783] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:26 2022] DELETE /identity/v3/projects/68db76d262a3486fb4f0c932cdf54158 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:26.905444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:26.915230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4334a26f-45f4-4287-b59d-45f37f5ebaf4 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:26.946768 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:26.979130 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:26.979716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:26.979985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:26.980257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] PATH_INFO: `/v3/users/539d170d204f4af48b45d7805f9713eb` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:26.981381 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539d170d204f4af48b45d7805f9713eb)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:26.983933 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.032589 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539d170d204f4af48b45d7805f9713eb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.039414 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539d170d204f4af48b45d7805f9713eb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.040341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539d170d204f4af48b45d7805f9713eb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.052651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539d170d204f4af48b45d7805f9713eb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.059222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539d170d204f4af48b45d7805f9713eb'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.066017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1411/2784] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:26 2022] DELETE /identity/v3/users/539d170d204f4af48b45d7805f9713eb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:27.180425 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.181968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.195583 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9018748-252c-4238-bbcb-81bb583a5281 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.260330 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.261033 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.261348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.261628 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] PATH_INFO: `/v3/users/d8dfb91b9d3846a79368563f42278d7c` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.262882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dfb91b9d3846a79368563f42278d7c)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.265196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.307312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:27.327479 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dfb91b9d3846a79368563f42278d7c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.335410 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dfb91b9d3846a79368563f42278d7c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.336374 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dfb91b9d3846a79368563f42278d7c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.343206 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.344814 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.347996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dfb91b9d3846a79368563f42278d7c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.348597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-26f7f570-656e-4d4e-9610-abdd2ffedc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dfb91b9d3846a79368563f42278d7c'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.366052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ebaf29-91ee-49cf-9036-e540aa2517d8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.371527 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.372167 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.372520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.375663 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] PATH_INFO: `/v3/projects/51c3f20487ef440a940b03b513989a9d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.376148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1374/2785] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:27 2022] DELETE /identity/v3/users/d8dfb91b9d3846a79368563f42278d7c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:27.376254 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c3f20487ef440a940b03b513989a9d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.376358 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.377038 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330954-375f-41e1-b702-87068f3bad69 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.377357 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330954-375f-41e1-b702-87068f3bad69 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.377633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92330954-375f-41e1-b702-87068f3bad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.398745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-92330954-375f-41e1-b702-87068f3bad69 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:27.400044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-92330954-375f-41e1-b702-87068f3bad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.429613 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c3f20487ef440a940b03b513989a9d', 'request_id': 'req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.437879 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c3f20487ef440a940b03b513989a9d', 'request_id': 'req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.444420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c3f20487ef440a940b03b513989a9d', 'request_id': 'req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.455341 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] The token cache is being invalidate because project 51c3f20487ef440a940b03b513989a9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:27.455655 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.456262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-12f1fdc6-a998-40cf-9bd9-a8a86479e7e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:27.458020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1412/2786] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:27 2022] DELETE /identity/v3/projects/51c3f20487ef440a940b03b513989a9d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:27.462061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1375/2787] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:27.465088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fae30-d8a9-430b-87d2-ece11d95e18b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.465088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fae30-d8a9-430b-87d2-ece11d95e18b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.465088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631fae30-d8a9-430b-87d2-ece11d95e18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.472194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330954-375f-41e1-b702-87068f3bad69 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.473534 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-92330954-375f-41e1-b702-87068f3bad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.484910 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-631fae30-d8a9-430b-87d2-ece11d95e18b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:27.486138 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-631fae30-d8a9-430b-87d2-ece11d95e18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.524785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:27.532393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92330954-375f-41e1-b702-87068f3bad69 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.567453 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1413/2788] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:27.576758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.577180 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.577558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.591063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.592394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.592713 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.592948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.601159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:27.602671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.604602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.607120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.614475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1414/2789] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:27.617003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.623347 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1376/2790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:27.629055 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbc06f1-40e9-4c72-8e3a-55ea1132d8e7 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.633853 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.634459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.634739 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.635013 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.635696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:27.636000 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.637618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.650210 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1415/2791] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:27.655292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.665985 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7071-3595-4f51-8bfc-73a4250be4d7 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.671079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.671812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.672659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.672659 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.673252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.675370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.691407 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:27.711884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1377/2792] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:27 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:27.715909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.727017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da321e8-9455-468e-a607-4a8bf8b0bcaa admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.793781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.793781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.793781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.793781 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.795225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.795892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.819670 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1416/2793] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:27 2022] POST /identity/v3/users => generated 281 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:27.823723 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.835130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d9fe7-33c2-46be-863d-e02ba383ae97 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.840225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.840900 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.841250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.842228 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.843251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.844929 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.855416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1378/2794] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:27.859817 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.870119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78f841-f3bf-4efe-a145-ac41c287f040 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.874998 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.875607 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.875888 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.876161 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.876808 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.878428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.890396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1417/2795] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:27.894690 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.905336 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe5569-bf1e-499b-a7ae-535bfd8cb9b7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.910664 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bcc05-29ea-4fea-b054-1bf3e328b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:27.911678 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bcc05-29ea-4fea-b054-1bf3e328b67f admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.911967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bcc05-29ea-4fea-b054-1bf3e328b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.912248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bcc05-29ea-4fea-b054-1bf3e328b67f admin admin] PATH_INFO: `/v3/projects/86a851fbfe6549eba0aa7d30bffb525b/users/6b9974292d7143bfa2d723b3d83f06fe/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.934518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bcc05-29ea-4fea-b054-1bf3e328b67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=86a851fbfe6549eba0aa7d30bffb525b, user_id=6b9974292d7143bfa2d723b3d83f06fe, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:27.934624 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bcc05-29ea-4fea-b054-1bf3e328b67f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:27.936232 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:27.938262 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:27.951365 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1379/2796] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:27 2022] PUT /identity/v3/projects/86a851fbfe6549eba0aa7d30bffb525b/users/6b9974292d7143bfa2d723b3d83f06fe/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:27.956200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad13ae-47c0-4641-9736-e06bfe7b53b2 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:27.962099 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:27.962760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:27.963547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:27.993437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] MFA Rules not processed for user `6b9974292d7143bfa2d723b3d83f06fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:27.994868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:28.019708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.020629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.020912 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.021186 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] PATH_INFO: `/v3/projects/2764d5b5b0b14f20b142da3c7c9b638a` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.022354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2764d5b5b0b14f20b142da3c7c9b638a)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.024240 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.067513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1380/2797] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:28.068071 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:28.068416 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.075747 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2764d5b5b0b14f20b142da3c7c9b638a', 'request_id': 'req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:28.080390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f5e286-3cbb-410d-a531-9a6975ed92d2 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.084505 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2764d5b5b0b14f20b142da3c7c9b638a', 'request_id': 'req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:28.091065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2764d5b5b0b14f20b142da3c7c9b638a', 'request_id': 'req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:28.101906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] The token cache is being invalidate because project 2764d5b5b0b14f20b142da3c7c9b638a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:28.102204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:28.102870 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:28.104516 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1418/2798] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:27 2022] DELETE /identity/v3/projects/2764d5b5b0b14f20b142da3c7c9b638a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:28.145691 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.146367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.146646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.146919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.147567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.149513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.179040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1381/2799] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:28 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:28.183376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.184896 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:28.198552 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169a78c7-06c5-4fbc-b5bc-37b03c04e6e0 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.271244 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.271581 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.271806 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.272086 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.273292 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.275065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.306108 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1419/2800] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:28 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:28.307558 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.320102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cbb5d-7bcb-40ac-99b1-b8abfd1a1faf admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.325406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.327080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.327212 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.327733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.328488 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.330296 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.342980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1382/2801] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:28.347978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.361353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a665fbc-a077-417e-912c-f22eac57b1f5 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.366523 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.367199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.367485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.367765 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] PATH_INFO: `/v3/projects/863ce9b81da14e399ce57db3c1a4196f/users/fdd2f18d155a4f0185b985436eaafe96/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.386513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863ce9b81da14e399ce57db3c1a4196f, user_id=fdd2f18d155a4f0185b985436eaafe96, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.391100 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.404679 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1420/2802] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:28 2022] PUT /identity/v3/projects/863ce9b81da14e399ce57db3c1a4196f/users/fdd2f18d155a4f0185b985436eaafe96/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:28.409406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.422456 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5c2b7-3a7d-4a6f-983d-4b1cf3753ea4 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.432978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:28.489331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d024803b-3ab5-4984-8dd9-1d7dd98be894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.489972 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024803b-3ab5-4984-8dd9-1d7dd98be894 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.490278 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024803b-3ab5-4984-8dd9-1d7dd98be894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.490546 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d024803b-3ab5-4984-8dd9-1d7dd98be894 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.491190 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024803b-3ab5-4984-8dd9-1d7dd98be894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.492804 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d024803b-3ab5-4984-8dd9-1d7dd98be894 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.504181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1383/2803] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:28.508506 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.519816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd11dd-acd0-4def-acb5-5f90d3856696 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.524609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.525287 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.525842 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.525936 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] PATH_INFO: `/v3/projects/863ce9b81da14e399ce57db3c1a4196f/users/fdd2f18d155a4f0185b985436eaafe96/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.527916 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863ce9b81da14e399ce57db3c1a4196f, user_id=fdd2f18d155a4f0185b985436eaafe96, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.530671 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.541570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1421/2804] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:28 2022] PUT /identity/v3/projects/863ce9b81da14e399ce57db3c1a4196f/users/fdd2f18d155a4f0185b985436eaafe96/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:28.553428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.553740 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.554044 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.585297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] MFA Rules not processed for user `fdd2f18d155a4f0185b985436eaafe96`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:28.586460 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:28.658809 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1384/2805] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:28.670220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.671892 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:28.733083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89cbd4-3753-48ee-91fe-f1cd0d74b644 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.736794 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.737407 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.737691 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.737997 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.747634 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.749778 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.759981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1422/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:28.846247 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:28.856399 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19eefce-347e-4ff4-a59b-d7d01c25ab0d None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:28.860751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:28.861476 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:28.861885 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:28.862225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:28.864384 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:28.925507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:28.926994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae898fd0-d714-4aae-a113-0558921baf88 service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:28.936553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1385/2807] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:31.668929 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:31.691431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:31.747053 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252ef1c0-9977-47c6-8338-af9da98ad165 service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:31.752444 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:31.753088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.753373 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.753651 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] PATH_INFO: `/v3/users/6b9974292d7143bfa2d723b3d83f06fe` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.754826 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b9974292d7143bfa2d723b3d83f06fe)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:31.756746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:31.809078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b9974292d7143bfa2d723b3d83f06fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:31.816995 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b9974292d7143bfa2d723b3d83f06fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:31.817678 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b9974292d7143bfa2d723b3d83f06fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:31.830599 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b9974292d7143bfa2d723b3d83f06fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:31.839382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b9974292d7143bfa2d723b3d83f06fe'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:31.846507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1423/2808] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:31 2022] DELETE /identity/v3/users/6b9974292d7143bfa2d723b3d83f06fe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:31.850928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:31.851458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:31.851559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:31.871478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:31.872699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:31.902453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:31.933100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1386/2809] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:31.943507 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:31.944935 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:32.003218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9ffe7-efdb-4e83-9a56-d9cf5babde50 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.006816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.007420 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.007703 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.007978 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.017530 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.018981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.028286 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1424/2810] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:32.309967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.312162 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:32.324406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b24356-d520-4a33-a5c9-f97f468dbedf None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.330135 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.330882 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.331246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.331609 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] PATH_INFO: `/v3/projects/86a851fbfe6549eba0aa7d30bffb525b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.332815 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86a851fbfe6549eba0aa7d30bffb525b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.335198 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.384082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86a851fbfe6549eba0aa7d30bffb525b', 'request_id': 'req-885ea6dd-46da-4644-9882-3f2ac637df26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.392974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86a851fbfe6549eba0aa7d30bffb525b', 'request_id': 'req-885ea6dd-46da-4644-9882-3f2ac637df26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.402380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86a851fbfe6549eba0aa7d30bffb525b', 'request_id': 'req-885ea6dd-46da-4644-9882-3f2ac637df26'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.413028 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] The token cache is being invalidate because project 86a851fbfe6549eba0aa7d30bffb525b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:32.413319 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.413983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.415780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1387/2811] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:32 2022] DELETE /identity/v3/projects/86a851fbfe6549eba0aa7d30bffb525b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:32.420465 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.429983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdbde90-ca4b-4224-ae26-56f08bf00647 service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.470079 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:32.488568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.489195 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.489478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.489785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] PATH_INFO: `/v3/users/fdd2f18d155a4f0185b985436eaafe96` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.490909 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd2f18d155a4f0185b985436eaafe96)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.492838 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.536876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd2f18d155a4f0185b985436eaafe96'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.544099 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd2f18d155a4f0185b985436eaafe96'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.544891 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd2f18d155a4f0185b985436eaafe96'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.557519 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd2f18d155a4f0185b985436eaafe96'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.563994 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5920d0e8-6606-475d-916b-632bbfa006e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd2f18d155a4f0185b985436eaafe96'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.570226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1425/2812] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:32 2022] DELETE /identity/v3/users/fdd2f18d155a4f0185b985436eaafe96 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:32.846152 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:32.847600 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:32.862349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ea6dd-46da-4644-9882-3f2ac637df26 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:32.925199 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:32.925869 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:32.926155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:32.926434 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] PATH_INFO: `/v3/projects/863ce9b81da14e399ce57db3c1a4196f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:32.927573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863ce9b81da14e399ce57db3c1a4196f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:32.929467 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:32.983194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863ce9b81da14e399ce57db3c1a4196f', 'request_id': 'req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.990545 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863ce9b81da14e399ce57db3c1a4196f', 'request_id': 'req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:32.992760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:32.998421 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863ce9b81da14e399ce57db3c1a4196f', 'request_id': 'req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:33.009884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] The token cache is being invalidate because project 863ce9b81da14e399ce57db3c1a4196f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:33.010176 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:33.010852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-bee5e3eb-70aa-4bfc-8fc8-87777e7904d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:33.012535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1388/2813] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:32 2022] DELETE /identity/v3/projects/863ce9b81da14e399ce57db3c1a4196f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:33.017865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.018342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.018459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.039083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:33.040620 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:33.105497 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1426/2814] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:33.113352 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.113640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.113948 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.133349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:33.134592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:33.143115 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1389/2815] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:33.147376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.158405 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef6f5-39a6-4131-9976-b4da6adc664a None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.163732 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.164083 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.164378 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.164686 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.165603 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:33.165948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.167543 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.180654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1427/2816] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:33.186045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.195182 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8e84d-3407-461f-85a2-e52942f28f13 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.199868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.200453 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.200736 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.201011 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.202325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.204216 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.230163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1390/2817] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:33.234676 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.244746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef1b66-ca0b-4ab4-8a5b-ca32a35f43d1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.289816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:33.303395 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.303990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.304380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.304658 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.305280 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.307223 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.330756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1428/2818] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/users => generated 305 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:33.335000 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.346233 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec5c3d-67be-4394-8071-22debe0eec3f admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.350996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.351597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.351881 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.352155 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.352802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.354767 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.367830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1391/2819] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:33.369121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.379801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0716428a-ff1d-4d4f-a9b9-bafe9bf6e502 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.384852 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ed2a3-6d20-4807-bf8f-58eac3fbbe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.385524 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ed2a3-6d20-4807-bf8f-58eac3fbbe9a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.385854 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ed2a3-6d20-4807-bf8f-58eac3fbbe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.386386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ed2a3-6d20-4807-bf8f-58eac3fbbe9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.386835 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ed2a3-6d20-4807-bf8f-58eac3fbbe9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.389336 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ed2a3-6d20-4807-bf8f-58eac3fbbe9a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.400875 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1429/2820] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:33.405074 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.415602 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5822a29c-508e-4b6a-8c55-fd4ece7a30ac admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.420622 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.421305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.421587 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.421904 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] PATH_INFO: `/v3/projects/48182aaa7e08470aaad8b7e18dd7cb81/users/99081f05ab8d495585fb0849921516a0/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.437811 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=48182aaa7e08470aaad8b7e18dd7cb81, user_id=99081f05ab8d495585fb0849921516a0, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.440461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.454874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1392/2821] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:33 2022] PUT /identity/v3/projects/48182aaa7e08470aaad8b7e18dd7cb81/users/99081f05ab8d495585fb0849921516a0/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:33.465588 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.465911 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.466233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.495121 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] MFA Rules not processed for user `99081f05ab8d495585fb0849921516a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:33.496318 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:33.563325 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1430/2822] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:33.567953 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.635529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774d753-7897-4080-ab90-e5b09a9a5e3d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.640636 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.641242 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.641521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.641825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.642473 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.644356 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.673926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1393/2823] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/projects => generated 409 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:33.678028 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.689499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ffdc-b740-4628-a24c-cf12ec4b76e8 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.752898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.753604 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.754043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.754376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.755080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.757067 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.780669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1431/2824] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:33 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:33.784586 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.814548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c227e-1467-4f9b-9a3d-dc9dd5645bb2 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.821110 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.821962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.822393 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.822679 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.823334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.825239 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.836527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1394/2825] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:33.840730 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.851756 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4496e-f432-43dd-b6b2-a079affd2260 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.856558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.857215 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.858200 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.858568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] PATH_INFO: `/v3/projects/043faaf1b3ac4eaba89de1353c1f23a1/users/ed8d728c53324348bffb9f4fcb92b96f/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.876885 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=043faaf1b3ac4eaba89de1353c1f23a1, user_id=ed8d728c53324348bffb9f4fcb92b96f, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.879773 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.893350 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1432/2826] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:33 2022] PUT /identity/v3/projects/043faaf1b3ac4eaba89de1353c1f23a1/users/ed8d728c53324348bffb9f4fcb92b96f/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:33.897166 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:33.907458 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0693be-f63b-4f1a-bf07-0b979f430eeb admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:33.962788 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:33.970380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaef12b-7300-4d50-8776-9001cd03d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:33.970999 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaef12b-7300-4d50-8776-9001cd03d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:33.971518 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaef12b-7300-4d50-8776-9001cd03d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:33.972046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaef12b-7300-4d50-8776-9001cd03d3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:33.973122 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaef12b-7300-4d50-8776-9001cd03d3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:33.975483 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaef12b-7300-4d50-8776-9001cd03d3c4 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:33.987331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1395/2827] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:33.991475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:34.002117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48560f-09a6-4716-8387-ce788208de1d admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:34.007021 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:34.007813 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.008103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.008382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] PATH_INFO: `/v3/projects/043faaf1b3ac4eaba89de1353c1f23a1/users/ed8d728c53324348bffb9f4fcb92b96f/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.010432 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] RBAC: Authorizing `identity:create_grant(project_id=043faaf1b3ac4eaba89de1353c1f23a1, user_id=ed8d728c53324348bffb9f4fcb92b96f, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:34.013091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:34.023555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1433/2828] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:33 2022] PUT /identity/v3/projects/043faaf1b3ac4eaba89de1353c1f23a1/users/ed8d728c53324348bffb9f4fcb92b96f/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:34.035592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.036007 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.036285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.064492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] MFA Rules not processed for user `ed8d728c53324348bffb9f4fcb92b96f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:34.065692 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:34.138125 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1396/2829] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:34.148738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:34.150459 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:34.162062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:34.210371 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a63f0c-2c6a-41d2-95b4-ca1ccc99941f admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:34.214041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6defe-8e3c-4368-a8e1-b643e08c1076 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:34.214643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6defe-8e3c-4368-a8e1-b643e08c1076 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.214926 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6defe-8e3c-4368-a8e1-b643e08c1076 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.215201 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6defe-8e3c-4368-a8e1-b643e08c1076 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.224668 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6defe-8e3c-4368-a8e1-b643e08c1076 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:34.226122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6defe-8e3c-4368-a8e1-b643e08c1076 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:34.236197 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1434/2830] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:34.411997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:34.422289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28473a99-c21a-43dc-9f40-115d45ea2763 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:34.425822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:34.426411 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:34.426689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:34.426960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:34.483437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:34.484909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:34.493752 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1397/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:35.229054 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8905fd-6b31-4050-8ec1-7710073791c7 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:35.229522 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8905fd-6b31-4050-8ec1-7710073791c7 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:35.229624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8905fd-6b31-4050-8ec1-7710073791c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:35.250052 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-0b8905fd-6b31-4050-8ec1-7710073791c7 None None] MFA Rules not processed for user `19e44a32c9b84242b3b2bc9b9e7ee975`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:35.251247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-0b8905fd-6b31-4050-8ec1-7710073791c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:35.306090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1435/2832] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:39.808630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:39.875001 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994ed689-3bb2-44d1-b55b-099b3157737d service cinder] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:39.879615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:39.880262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.880666 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.880941 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] PATH_INFO: `/v3/users/99081f05ab8d495585fb0849921516a0` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.882097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] RBAC: Authorizing `identity:delete_user(user_id=99081f05ab8d495585fb0849921516a0)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:39.883993 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:39.906980 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:39.937871 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99081f05ab8d495585fb0849921516a0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:39.944734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99081f05ab8d495585fb0849921516a0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:39.945391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99081f05ab8d495585fb0849921516a0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:39.954009 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99081f05ab8d495585fb0849921516a0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:39.954632 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99081f05ab8d495585fb0849921516a0'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:39.972940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1398/2833] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:39 2022] DELETE /identity/v3/users/99081f05ab8d495585fb0849921516a0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:39.977550 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:39.978081 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:39.978205 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:39.997966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:39.999273 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:40.062504 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1436/2834] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:40.071995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:40.073376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:40.129677 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150b21f-2b4c-4f2a-918b-bfa74df3949c admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:40.133273 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:40.133901 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:40.134180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:40.134446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:40.143363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:40.144778 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:40.154072 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1399/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:40.422204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:40.423811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:40.449076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeed2cc-91a5-4e39-9f03-02f78e677f16 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:40.455137 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:40.455811 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:40.456088 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:40.456394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] PATH_INFO: `/v3/projects/48182aaa7e08470aaad8b7e18dd7cb81` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:40.457532 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48182aaa7e08470aaad8b7e18dd7cb81)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:40.459470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:40.510252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48182aaa7e08470aaad8b7e18dd7cb81', 'request_id': 'req-b02ce8f6-286e-472c-aa31-97dff49a6066'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.512925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:40.520772 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48182aaa7e08470aaad8b7e18dd7cb81', 'request_id': 'req-b02ce8f6-286e-472c-aa31-97dff49a6066'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.529319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48182aaa7e08470aaad8b7e18dd7cb81', 'request_id': 'req-b02ce8f6-286e-472c-aa31-97dff49a6066'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.544115 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] The token cache is being invalidate because project 48182aaa7e08470aaad8b7e18dd7cb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:40.544410 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.545592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.547150 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1437/2836] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:40 2022] DELETE /identity/v3/projects/48182aaa7e08470aaad8b7e18dd7cb81 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:40.551262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:40.561470 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739bb3cb-c387-486a-beba-c9ef33f1d951 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:40.616842 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:40.617472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:40.617772 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:40.618046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] PATH_INFO: `/v3/users/ed8d728c53324348bffb9f4fcb92b96f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:40.619154 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8d728c53324348bffb9f4fcb92b96f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:40.621062 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:40.662465 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:40.672974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8d728c53324348bffb9f4fcb92b96f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.680241 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8d728c53324348bffb9f4fcb92b96f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.680968 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8d728c53324348bffb9f4fcb92b96f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.689020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8d728c53324348bffb9f4fcb92b96f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.689825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-b448187f-aa3e-40cc-a03f-18dd0ca0ed33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8d728c53324348bffb9f4fcb92b96f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:40.707978 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1400/2837] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:40 2022] DELETE /identity/v3/users/ed8d728c53324348bffb9f4fcb92b96f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:40.979069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:40.980657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:40.994385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce8f6-286e-472c-aa31-97dff49a6066 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.051792 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.052416 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.052696 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.052965 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] PATH_INFO: `/v3/projects/043faaf1b3ac4eaba89de1353c1f23a1` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.054107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=043faaf1b3ac4eaba89de1353c1f23a1)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.055983 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.101162 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '043faaf1b3ac4eaba89de1353c1f23a1', 'request_id': 'req-972f95f1-70a3-44c7-8be0-837f5dd86fbc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:41.108877 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '043faaf1b3ac4eaba89de1353c1f23a1', 'request_id': 'req-972f95f1-70a3-44c7-8be0-837f5dd86fbc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:41.115101 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '043faaf1b3ac4eaba89de1353c1f23a1', 'request_id': 'req-972f95f1-70a3-44c7-8be0-837f5dd86fbc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:41.125423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] The token cache is being invalidate because project 043faaf1b3ac4eaba89de1353c1f23a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:41.125735 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:41.126379 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-972f95f1-70a3-44c7-8be0-837f5dd86fbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:41.127865 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1438/2838] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:40 2022] DELETE /identity/v3/projects/043faaf1b3ac4eaba89de1353c1f23a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:41.132722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.133217 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.133370 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.156388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:41.157512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:41.216777 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1401/2839] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:41.225221 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.225510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.225857 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.245306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:41.246592 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:41.254567 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1439/2840] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:41.258715 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.269689 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a403a-104c-41af-a426-b462d29b71f8 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.274259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.274846 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.275123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.275392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.276034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:41.276335 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.278003 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.290312 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1402/2841] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:41.294785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.304183 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2bc49-f8d7-47f9-b85f-a191d983f7dd None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.308798 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.309392 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.309674 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.309981 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.310617 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.312500 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.340590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1440/2842] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:41 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:41.345633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.355428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7100e8b-1e20-485b-81f6-c4f6f64b7a94 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.414868 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.415446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.415970 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.416251 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.416886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.418824 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.439106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1403/2843] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:41 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:41.443449 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.454237 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071e682-230a-42b8-be2d-b4a29e1a8b13 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.461520 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.462225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.462475 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.462744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.463393 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.464986 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.475372 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1441/2844] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:41.479560 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.490013 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a25c3-d575-4a66-879b-e45066409211 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.494651 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8039cc-8809-4725-a994-c8494bb2c8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.495243 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8039cc-8809-4725-a994-c8494bb2c8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.495524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8039cc-8809-4725-a994-c8494bb2c8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.495794 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8039cc-8809-4725-a994-c8494bb2c8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.496443 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8039cc-8809-4725-a994-c8494bb2c8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.498067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8039cc-8809-4725-a994-c8494bb2c8e5 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.509252 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1404/2845] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:41.513467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.524106 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da24ba-eb2a-4781-982d-364defc169ed admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.528684 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.529335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.529627 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.529931 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] PATH_INFO: `/v3/projects/ca4b5b2366f648d68b3b917cb9741a6e/users/11380c37465640e99e862fead8b0c50b/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.668225 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca4b5b2366f648d68b3b917cb9741a6e, user_id=11380c37465640e99e862fead8b0c50b, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.671876 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.685362 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1442/2846] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:41 2022] PUT /identity/v3/projects/ca4b5b2366f648d68b3b917cb9741a6e/users/11380c37465640e99e862fead8b0c50b/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:41.706494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.706896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.707234 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.734919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] MFA Rules not processed for user `11380c37465640e99e862fead8b0c50b`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:41.736204 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:41.748693 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:41.802519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1405/2847] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:41.814290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.816025 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:41.826097 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:41.875897 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5d37-71a9-4c9b-b750-839ec63487c3 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.879549 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410b938-ed4a-4ed4-9f2c-d15a1bf87e40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.880148 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b938-ed4a-4ed4-9f2c-d15a1bf87e40 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.880428 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b938-ed4a-4ed4-9f2c-d15a1bf87e40 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.880697 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b938-ed4a-4ed4-9f2c-d15a1bf87e40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.889173 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410b938-ed4a-4ed4-9f2c-d15a1bf87e40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.890642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410b938-ed4a-4ed4-9f2c-d15a1bf87e40 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:41.899277 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1443/2848] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:41.922406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:41.986461 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab1553-04ab-45ab-9be1-de626191afa9 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:41.991097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:41.991714 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:41.991996 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:41.992268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] PATH_INFO: `/v3/users/11380c37465640e99e862fead8b0c50b` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:41.993397 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11380c37465640e99e862fead8b0c50b)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:41.995368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.042539 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11380c37465640e99e862fead8b0c50b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.050075 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11380c37465640e99e862fead8b0c50b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.050765 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11380c37465640e99e862fead8b0c50b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.057965 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11380c37465640e99e862fead8b0c50b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.058616 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11380c37465640e99e862fead8b0c50b'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.079673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1406/2849] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:41 2022] DELETE /identity/v3/users/11380c37465640e99e862fead8b0c50b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:42.081268 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.081758 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.081855 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.100446 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:42.101630 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:42.158574 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1444/2850] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:22:42.168428 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.169969 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:42.206391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:42.230650 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294f37e3-c29e-41cf-b771-b6f2cb145735 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.235120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a1440-14ca-4660-a54f-f72968238308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.235716 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1440-14ca-4660-a54f-f72968238308 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.235994 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1440-14ca-4660-a54f-f72968238308 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.236264 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a1440-14ca-4660-a54f-f72968238308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.245914 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1440-14ca-4660-a54f-f72968238308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.247449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a1440-14ca-4660-a54f-f72968238308 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.257376 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1407/2851] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:42.538787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.540339 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:42.553394 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3b80f-0700-43ec-b6aa-e9565ebcb87b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.558094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.558727 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.559009 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.559281 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] PATH_INFO: `/v3/projects/ca4b5b2366f648d68b3b917cb9741a6e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.560411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca4b5b2366f648d68b3b917cb9741a6e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.562458 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.610290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca4b5b2366f648d68b3b917cb9741a6e', 'request_id': 'req-5652a13b-5217-4db7-b34a-dcaba3e7f861'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.617383 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca4b5b2366f648d68b3b917cb9741a6e', 'request_id': 'req-5652a13b-5217-4db7-b34a-dcaba3e7f861'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.623689 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca4b5b2366f648d68b3b917cb9741a6e', 'request_id': 'req-5652a13b-5217-4db7-b34a-dcaba3e7f861'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.633925 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] The token cache is being invalidate because project ca4b5b2366f648d68b3b917cb9741a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:42.634213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.634850 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-5652a13b-5217-4db7-b34a-dcaba3e7f861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:42.636314 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1445/2852] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:42 2022] DELETE /identity/v3/projects/ca4b5b2366f648d68b3b917cb9741a6e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:42.642554 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.642844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.643123 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.663086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:42.664286 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:42.726069 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1408/2853] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:42.733624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.734004 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.734283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.754470 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:42.755699 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:42.764707 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1446/2854] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:42.768853 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.780385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f72a06-07e3-4614-8757-197fa7d1079f None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.785543 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.786225 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.786508 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.786786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.787449 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:42.787760 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.789354 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.803608 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1409/2855] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 30 00:22:42.807784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.818299 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5447a2-9be7-497e-9a43-a09f4bd09758 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.823198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.823816 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.824102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.824387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.825032 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.827495 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.858801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1447/2856] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:42.862861 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.873516 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a7607-92e7-4213-90ad-4a6c8100da47 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.938112 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.938717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.938998 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.939297 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.939945 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.941880 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:42.964271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1410/2857] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:42 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:22:42.968886 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:42.977139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:42.981329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7661fb-1ff8-47ca-b22d-462f66b2627c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:42.987235 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:42.988065 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:42.988540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:42.988831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:42.989915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:42.991748 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.002887 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1448/2858] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:43.007006 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:43.018331 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab483f39-6dd0-47ef-91ba-fffd88da3620 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:43.023102 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea11c2-9f7e-4854-a42e-6f173ec24aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:43.023699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea11c2-9f7e-4854-a42e-6f173ec24aeb admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.023984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea11c2-9f7e-4854-a42e-6f173ec24aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.024261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea11c2-9f7e-4854-a42e-6f173ec24aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.024909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea11c2-9f7e-4854-a42e-6f173ec24aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:43.026567 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea11c2-9f7e-4854-a42e-6f173ec24aeb admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.037184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1411/2859] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:43.041558 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:43.051586 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57da031-07a0-4a66-9aef-9e85cab730ee admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:43.056251 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:43.056893 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.057177 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.057454 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] PATH_INFO: `/v3/projects/b7e93d5584f8483c833668160cf64206/users/9db0141e596b4bb8b99ed7ced8bdcfc5/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.072545 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7e93d5584f8483c833668160cf64206, user_id=9db0141e596b4bb8b99ed7ced8bdcfc5, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:43.075234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.088565 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1449/2860] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:43 2022] PUT /identity/v3/projects/b7e93d5584f8483c833668160cf64206/users/9db0141e596b4bb8b99ed7ced8bdcfc5/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:43.098952 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.099238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.099507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.126734 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] MFA Rules not processed for user `9db0141e596b4bb8b99ed7ced8bdcfc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:43.127928 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:43.157078 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:43.191944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1412/2861] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:43.204107 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:43.205841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:43.261291 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb184b-f70f-4363-8201-cec6852a134a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:43.265580 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bcb8bb-1298-4ce6-bd9e-001764867e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:43.266228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb8bb-1298-4ce6-bd9e-001764867e21 service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.266511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb8bb-1298-4ce6-bd9e-001764867e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.266785 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bcb8bb-1298-4ce6-bd9e-001764867e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.275317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb8bb-1298-4ce6-bd9e-001764867e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:43.276741 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bcb8bb-1298-4ce6-bd9e-001764867e21 service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.285342 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1450/2862] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:43.310226 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:43.372739 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299f19b-7eb1-4b5a-9e89-6fcc62cbc08b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:43.377971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:43.378589 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.378874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.379174 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] PATH_INFO: `/v3/users/9db0141e596b4bb8b99ed7ced8bdcfc5` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.380305 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db0141e596b4bb8b99ed7ced8bdcfc5)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:43.382307 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.428256 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db0141e596b4bb8b99ed7ced8bdcfc5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:43.434910 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db0141e596b4bb8b99ed7ced8bdcfc5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:43.435581 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db0141e596b4bb8b99ed7ced8bdcfc5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:43.443394 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db0141e596b4bb8b99ed7ced8bdcfc5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:43.444055 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db0141e596b4bb8b99ed7ced8bdcfc5'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:43.460840 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1413/2863] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:43 2022] DELETE /identity/v3/users/9db0141e596b4bb8b99ed7ced8bdcfc5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:43.465247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.465536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.465845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.484883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:43.486114 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:43.542782 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1451/2864] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:43.553005 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:43.554447 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:43.612136 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c43f-69ac-4ef7-a0d5-93f7a616e3de admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:43.615808 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f058054-1442-420b-9681-0cd9d74b8323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:43.616406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058054-1442-420b-9681-0cd9d74b8323 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.616687 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058054-1442-420b-9681-0cd9d74b8323 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.616962 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f058054-1442-420b-9681-0cd9d74b8323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.622844 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:43.627271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058054-1442-420b-9681-0cd9d74b8323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:43.628931 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f058054-1442-420b-9681-0cd9d74b8323 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.639886 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1414/2865] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:22:43.905956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:43.907447 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:43.928880 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69686a3e-0c9c-4d80-b62b-5f10210e5059 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:43.934474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:43.935171 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:43.935340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:43.935624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] PATH_INFO: `/v3/projects/b7e93d5584f8483c833668160cf64206` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:43.937666 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7e93d5584f8483c833668160cf64206)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:43.940289 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:43.993960 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7e93d5584f8483c833668160cf64206', 'request_id': 'req-50e1105b-32c2-4cac-993b-1fc32f88fea5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:44.002605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7e93d5584f8483c833668160cf64206', 'request_id': 'req-50e1105b-32c2-4cac-993b-1fc32f88fea5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:44.009385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7e93d5584f8483c833668160cf64206', 'request_id': 'req-50e1105b-32c2-4cac-993b-1fc32f88fea5'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:44.015409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:44.022868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] The token cache is being invalidate because project b7e93d5584f8483c833668160cf64206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:44.023590 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:44.026092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-50e1105b-32c2-4cac-993b-1fc32f88fea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:44.027654 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1452/2866] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:43 2022] DELETE /identity/v3/projects/b7e93d5584f8483c833668160cf64206 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:22:44.034235 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.034521 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.034800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.056098 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:44.057346 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:44.125400 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1415/2867] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:44.133667 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.134256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.134256 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.155868 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:44.157087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:44.165084 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1453/2868] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:44.169751 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.180745 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60ef12-4d62-4e43-83d9-b753974527d4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.185390 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.186688 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.186974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.187263 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.187907 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:22:44.188213 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.189855 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.202720 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1416/2869] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:22:44.209562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.219049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482732ea-f144-4d3e-a65f-f145faae926b None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.223780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.224376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.224657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.224928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.225575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.227492 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.258007 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1454/2870] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:22:44 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:44.262455 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.273205 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2b8ea-d1a4-467d-ba88-662300adcb7d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.343463 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.344079 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.344361 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.344634 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.345274 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.347326 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.377538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1417/2871] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:22:44 2022] POST /identity/v3/users => generated 295 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:22:44.381834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.394609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36404da5-f644-411d-815f-2bce791985f4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.400172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.401166 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.401456 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.401753 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.402557 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.404172 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.420605 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1455/2872] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:22:44.421971 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.433169 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05988f9e-b6d8-444b-afce-9726605fed03 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.438896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef288de2-ec16-4350-bed3-08b8dd593372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.452085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288de2-ec16-4350-bed3-08b8dd593372 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.452540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288de2-ec16-4350-bed3-08b8dd593372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.452830 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef288de2-ec16-4350-bed3-08b8dd593372 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.453512 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef288de2-ec16-4350-bed3-08b8dd593372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.455183 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef288de2-ec16-4350-bed3-08b8dd593372 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.474631 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1418/2873] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:22:44.479104 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.491762 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bd699-3935-4b31-80a5-9a78719e49e1 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.499609 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.500288 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.500570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.500845 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] PATH_INFO: `/v3/projects/147ce2448ed84576ae4eaf8aeae7ca50/users/dfd2734518b641d5ad448b53622b5978/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.524513 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] RBAC: Authorizing `identity:create_grant(project_id=147ce2448ed84576ae4eaf8aeae7ca50, user_id=dfd2734518b641d5ad448b53622b5978, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.527257 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.544861 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1456/2874] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:22:44 2022] PUT /identity/v3/projects/147ce2448ed84576ae4eaf8aeae7ca50/users/dfd2734518b641d5ad448b53622b5978/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:44.555334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824a57-8782-4858-ae5d-5d930e0aa2dd None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.555614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824a57-8782-4858-ae5d-5d930e0aa2dd None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.555895 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22824a57-8782-4858-ae5d-5d930e0aa2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.589642 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-22824a57-8782-4858-ae5d-5d930e0aa2dd None None] MFA Rules not processed for user `dfd2734518b641d5ad448b53622b5978`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:44.590822 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-22824a57-8782-4858-ae5d-5d930e0aa2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:44.648472 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:44.669592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1419/2875] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:44.681937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:44.685160 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:44.755133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66231806-14f9-4489-a2c9-2042fd228988 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:44.758746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f458d5fcb964638be06e1bf21869250', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:44.759349 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:44.759642 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:44.759906 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:44.768990 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:44.770461 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:44.779012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1457/2876] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:53.201530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.202592 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.202744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.223257 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:53.224478 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:53.282106 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1420/2877] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Aug 30 00:22:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:53.321510 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:53.322955 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:53.394973 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b914da-c65e-4bef-8bc3-dd4683cc9c6d service cinder] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:53.399961 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266fe6c-ed90-4f01-a1a3-098f82077460 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:53.400562 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266fe6c-ed90-4f01-a1a3-098f82077460 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:53.400841 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266fe6c-ed90-4f01-a1a3-098f82077460 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:53.401113 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266fe6c-ed90-4f01-a1a3-098f82077460 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:53.409203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266fe6c-ed90-4f01-a1a3-098f82077460 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:53.410801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266fe6c-ed90-4f01-a1a3-098f82077460 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:53.418940 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1458/2878] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:22:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:22:54.944350 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:55.038696 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cd198-e544-4d45-9a0e-ebc82396b076 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:55.045148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:55.045995 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:55.046540 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:55.047067 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] PATH_INFO: `/v3/users/dfd2734518b641d5ad448b53622b5978` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:55.049246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd2734518b641d5ad448b53622b5978)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:55.052108 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:55.137786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd2734518b641d5ad448b53622b5978'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:55.147940 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd2734518b641d5ad448b53622b5978'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:55.148818 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd2734518b641d5ad448b53622b5978'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:55.159828 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd2734518b641d5ad448b53622b5978'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:55.160385 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd2734518b641d5ad448b53622b5978'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:55.189743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1421/2879] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:22:54 2022] DELETE /identity/v3/users/dfd2734518b641d5ad448b53622b5978 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:22:55.195125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:55.195716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:55.195716 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:55.238386 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:22:55.240116 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:55.269026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:55.463230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1459/2880] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:22:55.469612 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:55.471143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:55.487721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:22:55.547409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc83311-bde2-4882-a151-8a5b5bb4cd6d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:55.551494 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d905e28-a221-48e1-93e4-d288535b48cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:55.552196 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905e28-a221-48e1-93e4-d288535b48cb service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:55.552552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905e28-a221-48e1-93e4-d288535b48cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:55.552896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d905e28-a221-48e1-93e4-d288535b48cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:55.564261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d905e28-a221-48e1-93e4-d288535b48cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:55.565888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d905e28-a221-48e1-93e4-d288535b48cb service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:55.576722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1422/2881] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:22:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 30 00:22:55.921843 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:22:55.925832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:22:55.946370 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb72a18-a820-4f59-94fb-7633af9fc5ab None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:22:55.959384 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:22:55.960063 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:22:55.964307 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:22:55.964701 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] PATH_INFO: `/v3/projects/147ce2448ed84576ae4eaf8aeae7ca50` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:22:55.965944 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=147ce2448ed84576ae4eaf8aeae7ca50)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:22:55.971831 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:22:56.043283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '147ce2448ed84576ae4eaf8aeae7ca50', 'request_id': 'req-fe9d84e3-15f9-4a6b-8410-81763035db5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:56.051074 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '147ce2448ed84576ae4eaf8aeae7ca50', 'request_id': 'req-fe9d84e3-15f9-4a6b-8410-81763035db5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:56.057905 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '147ce2448ed84576ae4eaf8aeae7ca50', 'request_id': 'req-fe9d84e3-15f9-4a6b-8410-81763035db5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:56.069824 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] The token cache is being invalidate because project 147ce2448ed84576ae4eaf8aeae7ca50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:22:56.070123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:56.070818 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:22:56.072312 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1460/2882] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:22:55 2022] DELETE /identity/v3/projects/147ce2448ed84576ae4eaf8aeae7ca50 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:05.572535 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=20 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:06.066738 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:07.929733 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:07.930220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:07.930334 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:07.949944 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:07.951137 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:08.005258 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1423/2883] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 00:23:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:08.018783 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:08.020179 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:08.090669 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d84e3-15f9-4a6b-8410-81763035db5e admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:08.095643 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:08.096243 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:08.096529 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:08.096802 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:08.104745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:08.106354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:08.114810 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1461/2884] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:23:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:23:10.054320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.055780 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:10.123173 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c01d2-c543-4cfb-98a1-4878241dc337 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.128471 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.129113 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.129379 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.129657 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] PATH_INFO: `/v3/users/19e44a32c9b84242b3b2bc9b9e7ee975` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.130827 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19e44a32c9b84242b3b2bc9b9e7ee975)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.132737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.177388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19e44a32c9b84242b3b2bc9b9e7ee975'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.184087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19e44a32c9b84242b3b2bc9b9e7ee975'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.184754 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19e44a32c9b84242b3b2bc9b9e7ee975'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.192389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19e44a32c9b84242b3b2bc9b9e7ee975'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.193016 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-28224e88-ca80-4660-9d18-7d6b76e4cfc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19e44a32c9b84242b3b2bc9b9e7ee975'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.210547 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1424/2885] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:23:10 2022] DELETE /identity/v3/users/19e44a32c9b84242b3b2bc9b9e7ee975 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:10.624203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.635958 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cb413-363f-48be-b7f6-0a52a00f8ec4 service swift] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.692578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.693202 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.693485 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.693788 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] PATH_INFO: `/v3/projects/9084e04e2f2341b4befb3b5c361b64f6` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.694899 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9084e04e2f2341b4befb3b5c361b64f6)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.696776 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.743143 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9084e04e2f2341b4befb3b5c361b64f6', 'request_id': 'req-560bdb68-7c71-4134-a497-fed71444285d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.750087 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9084e04e2f2341b4befb3b5c361b64f6', 'request_id': 'req-560bdb68-7c71-4134-a497-fed71444285d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.756509 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9084e04e2f2341b4befb3b5c361b64f6', 'request_id': 'req-560bdb68-7c71-4134-a497-fed71444285d'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.766722 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] The token cache is being invalidate because project 9084e04e2f2341b4befb3b5c361b64f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:23:10.767006 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.767629 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-560bdb68-7c71-4134-a497-fed71444285d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:10.769102 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1462/2886] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:23:10 2022] DELETE /identity/v3/projects/9084e04e2f2341b4befb3b5c361b64f6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:10.773997 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.774284 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.774565 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.794909 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:10.796119 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:10.818629 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.864482 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1425/2887] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:10.872220 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.872511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.872796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.893117 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:10.894357 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:10.902226 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1463/2888] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:10.906409 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.916896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df47d7-7595-4188-b09a-b1bc3431abba None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.922500 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.923771 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.923960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.924237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] PATH_INFO: `/v3/domains` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.924923 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81661) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:10.925246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.926905 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.939884 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1426/2889] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:10.944290 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:10.953517 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f257c359-1b7c-49fb-99f5-395ca88f4c83 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:10.958409 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:10.958996 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:10.959276 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:10.959544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] PATH_INFO: `/v3/projects` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:10.960168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:10.962080 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:10.973790 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:10.992578 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1464/2890] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:23:10 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:10.996926 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.007180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74f38f-f45e-4f06-a56a-d88aaf832331 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.064492 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.065145 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.065358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.065633 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] PATH_INFO: `/v3/users` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.066292 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.068203 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.088984 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1427/2891] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:23:10 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:11.093057 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.103364 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70fffc-2680-4806-875d-0bfc38db4030 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.107963 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.108554 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.108832 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.109103 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.109770 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.112037 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.122129 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1465/2892] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:23:11.126673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.136562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e13534-ff68-41d2-b8f2-6a8c49afc182 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.141178 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec082d7c-1e56-4be0-863e-d7357d1c339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.141834 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec082d7c-1e56-4be0-863e-d7357d1c339c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.142126 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec082d7c-1e56-4be0-863e-d7357d1c339c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.142401 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec082d7c-1e56-4be0-863e-d7357d1c339c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.143048 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec082d7c-1e56-4be0-863e-d7357d1c339c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.144619 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec082d7c-1e56-4be0-863e-d7357d1c339c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.154874 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1428/2893] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:23:11.159051 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.168968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e137a10-0eea-4918-8faf-b68114200742 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.174123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.174757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.175038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.175309 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] PATH_INFO: `/v3/projects/afbc9917a3cd4f62bb7c5c80bac10569/users/d85fcd4fc7d7490ca5b7a54b8f928978/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.190322 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afbc9917a3cd4f62bb7c5c80bac10569, user_id=d85fcd4fc7d7490ca5b7a54b8f928978, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.192928 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.205693 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1466/2894] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:23:11 2022] PUT /identity/v3/projects/afbc9917a3cd4f62bb7c5c80bac10569/users/d85fcd4fc7d7490ca5b7a54b8f928978/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:11.215646 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.215964 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.216382 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.244021 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] MFA Rules not processed for user `d85fcd4fc7d7490ca5b7a54b8f928978`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:11.245262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:11.311820 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1429/2895] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:11.323230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:11.324895 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:11.380438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b057d5-6221-4a37-a8b4-e3059e8d4dd8 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:11.384076 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '274f72b3a3c34d6388ff820627f2f4cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:11.384720 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:11.385044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:11.385385 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:11.395159 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:11.396570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:11.405017 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1467/2896] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:23:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:23:21.308847 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:21.401239 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:29.904250 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:29.905672 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:30.046147 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e60eba-f111-48eb-ba3f-f178ed057d4e None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:30.051202 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:30.051796 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:30.052080 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:30.052349 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:30.054100 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:30.065268 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:30.067143 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fad7c6-ba07-4ced-8c7e-e7430e95aeed service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:30.077507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1430/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:23:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:23:34.015624 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.114478 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385e18-539f-41a4-9869-3688a53d4ccc service glance] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.119077 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.119745 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.120026 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.120302 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] PATH_INFO: `/v3/users/d85fcd4fc7d7490ca5b7a54b8f928978` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.121439 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85fcd4fc7d7490ca5b7a54b8f928978)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.123376 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.170568 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85fcd4fc7d7490ca5b7a54b8f928978'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.177786 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85fcd4fc7d7490ca5b7a54b8f928978'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.178491 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85fcd4fc7d7490ca5b7a54b8f928978'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.190199 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85fcd4fc7d7490ca5b7a54b8f928978'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.197615 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85fcd4fc7d7490ca5b7a54b8f928978'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.203544 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1468/2898] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:23:34 2022] DELETE /identity/v3/users/d85fcd4fc7d7490ca5b7a54b8f928978 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:34.208218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.208710 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.208837 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.249116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:34.250375 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:34.314825 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1431/2899] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:34.325043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.326488 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:34.373575 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.385012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02816ea-b3e6-4789-8b42-c9ec37d3034c admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.389482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d38c0d9-c75c-4bfd-809c-a89fbdbae80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.390119 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c0d9-c75c-4bfd-809c-a89fbdbae80e service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.390408 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c0d9-c75c-4bfd-809c-a89fbdbae80e service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.390681 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d38c0d9-c75c-4bfd-809c-a89fbdbae80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.399914 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c0d9-c75c-4bfd-809c-a89fbdbae80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.401957 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d38c0d9-c75c-4bfd-809c-a89fbdbae80e service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.411387 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1469/2900] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:23:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:23:34.678935 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:34.680303 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:34.689060 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=100 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:34.693661 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa34368-fce0-4b88-90cd-90138affa47b None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:34.699338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:34.700086 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:34.700441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:34.700728 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] PATH_INFO: `/v3/projects/afbc9917a3cd4f62bb7c5c80bac10569` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:34.702576 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afbc9917a3cd4f62bb7c5c80bac10569)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:34.704423 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:34.752220 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afbc9917a3cd4f62bb7c5c80bac10569', 'request_id': 'req-598eabd7-47ec-4553-bb27-f636a7e32d58'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.759614 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afbc9917a3cd4f62bb7c5c80bac10569', 'request_id': 'req-598eabd7-47ec-4553-bb27-f636a7e32d58'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.766812 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afbc9917a3cd4f62bb7c5c80bac10569', 'request_id': 'req-598eabd7-47ec-4553-bb27-f636a7e32d58'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.777813 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] The token cache is being invalidate because project afbc9917a3cd4f62bb7c5c80bac10569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:23:34.778104 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.778744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:34.780294 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1432/2901] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:23:34 2022] DELETE /identity/v3/projects/afbc9917a3cd4f62bb7c5c80bac10569 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:23:42.978706 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:42.979191 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:42.979310 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.009641 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] MFA Rules not processed for user `6896402969554f88ae946f35aed55bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:43.011029 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:43.073807 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1470/2902] 10.222.0.43 () {58 vars in 967 bytes} [Tue Aug 30 00:23:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:43.086441 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:43.087854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:43.159383 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598eabd7-47ec-4553-bb27-f636a7e32d58 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:43.164448 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5be0312450644dd69a7c7263e347b28b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:43.165046 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:43.165325 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:43.165596 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:43.173954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:43.175553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:43.183495 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1433/2903] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Aug 30 00:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 30 00:23:49.921317 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:49.922822 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:49.988213 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85a61-f2d2-4b3c-8f52-58f6178b026c None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:49.992744 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:49.993369 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:49.993649 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:49.993948 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] PATH_INFO: `/v3/users/8d770833178c4a6d927532c71c21b3bc` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:49.995066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d770833178c4a6d927532c71c21b3bc)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:49.997540 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.044570 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d770833178c4a6d927532c71c21b3bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.051657 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d770833178c4a6d927532c71c21b3bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.052319 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d770833178c4a6d927532c71c21b3bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.065003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d770833178c4a6d927532c71c21b3bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.068610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.072639 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d770833178c4a6d927532c71c21b3bc'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.080746 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1471/2904] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:23:49 2022] DELETE /identity/v3/users/8d770833178c4a6d927532c71c21b3bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:50.251045 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.267685 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995abd6-ba0c-4464-b53a-58e8a58147ea service swift] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.326704 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.327246 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.327527 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.327795 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] PATH_INFO: `/v3/projects/50106119584a45728b2091af8f1fac2f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.328930 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50106119584a45728b2091af8f1fac2f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.330854 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.351485 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:50.378148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50106119584a45728b2091af8f1fac2f', 'request_id': 'req-13d45eac-8480-4180-a6e3-f6e012e10470'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.385403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50106119584a45728b2091af8f1fac2f', 'request_id': 'req-13d45eac-8480-4180-a6e3-f6e012e10470'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.393041 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50106119584a45728b2091af8f1fac2f', 'request_id': 'req-13d45eac-8480-4180-a6e3-f6e012e10470'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.406111 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] The token cache is being invalidate because project 50106119584a45728b2091af8f1fac2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:23:50.406406 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.407071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.408593 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1434/2905] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:23:50 2022] DELETE /identity/v3/projects/50106119584a45728b2091af8f1fac2f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:50.412591 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.414027 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:50.427396 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c05ba-9413-4730-b6a4-d3b3ca23a8c4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.486608 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.487233 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.487518 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.487793 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] PATH_INFO: `/v3/users/621da200e6f74403b41d41dce146dd5e` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.488962 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621da200e6f74403b41d41dce146dd5e)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.490883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.538647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621da200e6f74403b41d41dce146dd5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.550934 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621da200e6f74403b41d41dce146dd5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.551660 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621da200e6f74403b41d41dce146dd5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.565203 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621da200e6f74403b41d41dce146dd5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.584282 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-fea6aeac-060f-4a91-84c3-2763b1bf4323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621da200e6f74403b41d41dce146dd5e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.587482 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1472/2906] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:23:50 2022] DELETE /identity/v3/users/621da200e6f74403b41d41dce146dd5e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:50.761259 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:50.763403 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:50.776898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d45eac-8480-4180-a6e3-f6e012e10470 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:50.834686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:50.835237 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.835519 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.835790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] PATH_INFO: `/v3/projects/87d458831a22411fbf9c87f3b0f3bcf3` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.836911 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87d458831a22411fbf9c87f3b0f3bcf3)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:50.838851 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:50.885261 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87d458831a22411fbf9c87f3b0f3bcf3', 'request_id': 'req-56cfb468-0e64-4ca5-bda6-795a982a2d51'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.893191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87d458831a22411fbf9c87f3b0f3bcf3', 'request_id': 'req-56cfb468-0e64-4ca5-bda6-795a982a2d51'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.899387 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87d458831a22411fbf9c87f3b0f3bcf3', 'request_id': 'req-56cfb468-0e64-4ca5-bda6-795a982a2d51'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.909573 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] The token cache is being invalidate because project 87d458831a22411fbf9c87f3b0f3bcf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81661) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:23:50.909897 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.910530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-56cfb468-0e64-4ca5-bda6-795a982a2d51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:23:50.912020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1435/2907] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:23:50 2022] DELETE /identity/v3/projects/87d458831a22411fbf9c87f3b0f3bcf3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:50.917094 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:50.917451 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:50.917812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:50.967222 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:50.968415 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:51.013125 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.028682 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1473/2908] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:51.036548 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5264585-0e69-4026-b810-df268f774598 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.036865 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5264585-0e69-4026-b810-df268f774598 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.037141 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5264585-0e69-4026-b810-df268f774598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.057437 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-e5264585-0e69-4026-b810-df268f774598 None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:51.058707 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-e5264585-0e69-4026-b810-df268f774598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:51.067148 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1436/2909] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:51.071266 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.081618 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328bde-01be-4864-8eda-c60cc878a901 None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.086187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.086723 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.087003 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.087274 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.087915 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81662) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 30 00:23:51.088219 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.089812 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.102154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1474/2910] 10.222.0.43 () {58 vars in 1153 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 30 00:23:51.106378 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5264585-0e69-4026-b810-df268f774598 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.115371 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5264585-0e69-4026-b810-df268f774598 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.119976 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.120559 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.120841 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.121116 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.121776 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.123790 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.150975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1437/2911] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:23:51 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:51.155708 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.165759 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da47af-430f-4e67-a8a9-bacd1d840a2a admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.222612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.223204 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.223512 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.223780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.224434 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.226353 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.246467 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1475/2912] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:23:51 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:51.250983 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.261282 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405a652-1817-465d-a0e7-c819447453ce admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.266770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.267363 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.267640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.267908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.268550 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.270163 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.272289 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:51.281766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1438/2913] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:23:51.285985 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.297010 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ae97f-7825-480f-885f-1605a2ab25a6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.301596 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e48d30-c8fa-445f-80ac-4d7baee4ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.302218 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48d30-c8fa-445f-80ac-4d7baee4ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.302499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48d30-c8fa-445f-80ac-4d7baee4ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.302769 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e48d30-c8fa-445f-80ac-4d7baee4ad11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.303403 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48d30-c8fa-445f-80ac-4d7baee4ad11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.304966 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e48d30-c8fa-445f-80ac-4d7baee4ad11 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.316308 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1476/2914] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 30 00:23:51.320529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.331348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032c39b-7f41-4385-8e41-9d95cf2fc4d7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.335967 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.336684 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.336915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.337189 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] PATH_INFO: `/v3/projects/3cf4deb459274fd296fcdb1078ebf678/users/970066df62394057ae5f1be39763373f/roles/aa7cc9bc9e7a431ba36301ab51130045` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.351698 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf4deb459274fd296fcdb1078ebf678, user_id=970066df62394057ae5f1be39763373f, role_id=aa7cc9bc9e7a431ba36301ab51130045)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.354389 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.367306 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1439/2915] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:23:51 2022] PUT /identity/v3/projects/3cf4deb459274fd296fcdb1078ebf678/users/970066df62394057ae5f1be39763373f/roles/aa7cc9bc9e7a431ba36301ab51130045 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:51.372784 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701cc6a-7515-4f32-bd49-3bc7a7d0cf5d None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.373070 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701cc6a-7515-4f32-bd49-3bc7a7d0cf5d None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.373340 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701cc6a-7515-4f32-bd49-3bc7a7d0cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.392382 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-c701cc6a-7515-4f32-bd49-3bc7a7d0cf5d None None] MFA Rules not processed for user `87f9b76a136e4875a30812fb5a16d50e`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:51.393616 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c701cc6a-7515-4f32-bd49-3bc7a7d0cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:51.451423 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1477/2916] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:51.461022 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:51.462919 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:51.539063 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0629eb6-647d-4ba1-9288-2c39c97182c0 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:51.542722 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:51.543318 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:51.543598 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:51.544020 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:51.553524 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:51.554974 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:51.564766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1440/2917] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:23:55.566234 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.566726 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.566840 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.597175 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] MFA Rules not processed for user `970066df62394057ae5f1be39763373f`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:23:55.598438 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:23:55.646698 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:23:55.668168 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1478/2918] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:23:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:23:55.673654 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.683348 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26719bf5-7b9f-4414-99bf-61a0034050fe service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.688799 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.689388 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.689669 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.689975 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.690615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.692507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.719255 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1441/2919] 10.222.0.43 () {60 vars in 1153 bytes} [Tue Aug 30 00:23:55 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 30 00:23:55.723499 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.735064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0deb0-8ea5-4cb7-b8f6-087d52f8e6ba None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.790898 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.791511 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.791800 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.792078 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] PATH_INFO: `/v3/users` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.792719 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.795921 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.816956 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1479/2920] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Aug 30 00:23:55 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 30 00:23:55.820924 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.831599 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f25de-eb80-4b4e-b628-e90e2c6365b7 admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.836218 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.836843 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.837121 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.837391 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.838071 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.839675 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.851285 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1442/2921] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:23:55.855661 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.866937 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2d654-7605-4f45-8422-1f6382ea9fbe admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.871780 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.873126 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.873489 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.873804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] PATH_INFO: `/v3/projects/257ad820b1744ff885727df9281522c6/users/0eaadedcb89b4febb9cb72c1e6658433/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.889147 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=257ad820b1744ff885727df9281522c6, user_id=0eaadedcb89b4febb9cb72c1e6658433, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.892041 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.905531 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1480/2922] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:23:55 2022] PUT /identity/v3/projects/257ad820b1744ff885727df9281522c6/users/0eaadedcb89b4febb9cb72c1e6658433/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:23:55.909499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:55.920528 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d4855-a6ff-417e-9305-c3a514fa2f5d admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:55.979191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a1847-3ed8-419f-8e5d-d7c05cdab25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:55.979807 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1847-3ed8-419f-8e5d-d7c05cdab25c admin admin] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:55.980097 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1847-3ed8-419f-8e5d-d7c05cdab25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:55.980367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a1847-3ed8-419f-8e5d-d7c05cdab25c admin admin] PATH_INFO: `/v3/roles` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:55.981014 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1847-3ed8-419f-8e5d-d7c05cdab25c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:55.983271 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a1847-3ed8-419f-8e5d-d7c05cdab25c admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:55.993133 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1443/2923] 10.222.0.43 () {58 vars in 1122 bytes} [Tue Aug 30 00:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 30 00:23:55.997514 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:23:56.008555 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845ceec-1908-424c-9b43-603ba94656ed admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:23:56.013246 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:23:56.013913 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:23:56.014198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:23:56.014472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] PATH_INFO: `/v3/projects/257ad820b1744ff885727df9281522c6/users/0eaadedcb89b4febb9cb72c1e6658433/roles/46ba8574dccb497790ae947ec68f522d` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:23:56.016374 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=257ad820b1744ff885727df9281522c6, user_id=0eaadedcb89b4febb9cb72c1e6658433, role_id=46ba8574dccb497790ae947ec68f522d)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:23:56.019020 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:23:56.030329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1481/2924] 10.222.0.43 () {60 vars in 1483 bytes} [Tue Aug 30 00:23:55 2022] PUT /identity/v3/projects/257ad820b1744ff885727df9281522c6/users/0eaadedcb89b4febb9cb72c1e6658433/roles/46ba8574dccb497790ae947ec68f522d => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:24:00.487817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e750-b6dc-4a29-84c7-43a66b380cf8 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.488380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e750-b6dc-4a29-84c7-43a66b380cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.488380 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9e750-b6dc-4a29-84c7-43a66b380cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.518320 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-9ec9e750-b6dc-4a29-84c7-43a66b380cf8 None None] MFA Rules not processed for user `0eaadedcb89b4febb9cb72c1e6658433`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:00.519553 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9ec9e750-b6dc-4a29-84c7-43a66b380cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:00.536180 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.654085 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1444/2925] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:24:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:24:00.666402 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:00.668457 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:00.810801 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cd6163-965a-46ff-8dd8-2f3f59ae1cb4 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:00.817123 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:00.817757 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:00.818036 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:00.818306 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:00.837023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:00.888919 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:00.890791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:00.901139 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1482/2926] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:24:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:24:01.903200 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:01.903744 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:01.903908 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:01.924412 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] MFA Rules not processed for user `970066df62394057ae5f1be39763373f`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:24:01.925623 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:24:01.932544 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1445/2927] 10.222.0.43 () {58 vars in 958 bytes} [Tue Aug 30 00:24:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:24:10.896846 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=20 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:11.917730 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=28 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:24:26.691521 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:24:26.746380 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8c7f86-95c1-4ab4-8d79-f6f9080aa397 service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:24:26.749878 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:24:26.750471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:24:26.750751 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:24:26.751024 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:24:26.759918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:24:26.761332 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:24:26.770918 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1483/2928] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:24:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:24:36.766791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=26 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:20.599082 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:20.609766 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4d391-4e46-42ba-a352-08ec9595b5a4 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:20.614131 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:20.614757 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:20.615040 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:20.615313 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:20.617070 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:20.630663 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:20.632088 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:20.643043 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1446/2929] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:21.831787 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:21.840474 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030775a7-616a-44c5-93e7-2ea05090db0d service neutron] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:21.844247 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:21.844839 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:21.845122 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:21.845398 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:21.847443 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:21.861283 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:21.862724 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a92d9-0346-49ff-8946-439308049a81 service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:21.874091 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1484/2930] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:30.638191 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=6 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:30.732367 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:30.733832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:30.745339 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6b6f0-f8df-4e5f-9c91-8de17a860190 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:30.749120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:30.749738 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:30.750034 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:30.750308 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:30.752030 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:30.762530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:30.763942 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864a433-fa63-4b23-b8a9-305294349b8a service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:30.771954 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1447/2931] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:31.869228 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=6 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:33.874133 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf974-dd56-4728-94aa-2a925f2fdbcb None None] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:33.874796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf974-dd56-4728-94aa-2a925f2fdbcb None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:33.874796 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93daf974-dd56-4728-94aa-2a925f2fdbcb None None] PATH_INFO: `/` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:33.876064 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1485/2932] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:33.882295 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a8eae-2c0a-464b-9bc7-039d0625f6f6 None None] REQUEST_METHOD: `POST` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:33.882786 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a8eae-2c0a-464b-9bc7-039d0625f6f6 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:33.882896 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097a8eae-2c0a-464b-9bc7-039d0625f6f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:33.926530 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.auth.core [None req-097a8eae-2c0a-464b-9bc7-039d0625f6f6 None None] MFA Rules not processed for user `2e45f572e4d94afc98c4a68b11ab4b36`. Rule list: `[]` (Enabled: `True`). {{(pid=81661) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:33.928489 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-097a8eae-2c0a-464b-9bc7-039d0625f6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:33.936288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1448/2933] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:26:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 30 00:26:33.949141 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf974-dd56-4728-94aa-2a925f2fdbcb None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:33.960471 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93daf974-dd56-4728-94aa-2a925f2fdbcb None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:33.964092 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d2bda-8a56-475b-af0b-ba0f56d3532e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:33.964695 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2bda-8a56-475b-af0b-ba0f56d3532e service neutron] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:33.964977 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2bda-8a56-475b-af0b-ba0f56d3532e service neutron] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:33.965252 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d2bda-8a56-475b-af0b-ba0f56d3532e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:33.972534 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2bda-8a56-475b-af0b-ba0f56d3532e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:33.974683 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d2bda-8a56-475b-af0b-ba0f56d3532e service neutron] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:33.985018 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1486/2934] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:34.072832 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877b8da-c06d-4c0f-9102-75830108ac04 None None] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:34.073120 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877b8da-c06d-4c0f-9102-75830108ac04 None None] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:34.073392 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877b8da-c06d-4c0f-9102-75830108ac04 None None] PATH_INFO: `/` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:34.074888 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1449/2935] 10.222.0.43 () {54 vars in 921 bytes} [Tue Aug 30 00:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 30 00:26:34.080042 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] REQUEST_METHOD: `POST` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:34.080335 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:34.080612 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:34.118833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.auth.core [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] MFA Rules not processed for user `118462014bfa41e388b6bb0be1d208d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81662) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 30 00:26:34.120049 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:34.129258 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1487/2936] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Aug 30 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 30 00:26:34.140167 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877b8da-c06d-4c0f-9102-75830108ac04 None None] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:34.151238 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877b8da-c06d-4c0f-9102-75830108ac04 None None] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:34.154770 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e45f572e4d94afc98c4a68b11ab4b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:34.155360 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:34.155640 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:34.155915 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:34.166424 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:34.167852 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:34.179194 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1450/2937] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:34.238431 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:34.240551 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:34.308038 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f7b50-bdb1-457a-83da-3160344ad96e None None] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:34.313192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:34.313834 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:34.314118 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:34.314417 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:34.316170 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:34.327597 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:34.329154 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:34.339541 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1488/2938] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:37.635800 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:26:37.637159 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:37.653061 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764213e4-5c14-4af1-a79f-a1925a057496 service neutron] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:26:37.658648 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:26:37.659248 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:26:37.659529 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:26:37.659802 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:26:37.662484 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:26:37.674936 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:26:37.676756 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:26:37.688615 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1451/2939] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:26:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:26:44.335418 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=47 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:26:47.684717 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=27 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:27:52.410236 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:52.427890 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf194d9-b7be-4b51-9892-569ac771833b service placement] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:52.433411 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:52.434536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:52.434536 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:52.434761 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:52.436328 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:52.450968 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:52.452640 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:52.464833 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1489/2940] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:27:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:27:54.778817 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:54.793898 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de28687-e49d-44ce-81f8-c1e37c2f787e service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:54.799973 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '118462014bfa41e388b6bb0be1d208d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:54.800630 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:54.802368 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:54.802864 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:54.805618 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:54.819960 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:54.821829 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:54.834338 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1452/2941] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:27:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:27:59.209192 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:27:59.220872 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6e30f-b857-4c51-ba01-b7107dc902c7 service nova] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:27:59.226333 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:27:59.227044 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] REQUEST_METHOD: `GET` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:27:59.227329 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:27:59.227606 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:27:59.229399 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:27:59.242062 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:27:59.243647 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:27:59.255043 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1490/2942] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:27:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:02.255761 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:02.325686 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9389ac-a104-413d-8148-479150d9d849 service nova] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:02.330719 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:02.331436 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:02.331743 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:02.332562 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] PATH_INFO: `/v3/users/970066df62394057ae5f1be39763373f` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:02.333721 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] RBAC: Authorizing `identity:delete_user(user_id=970066df62394057ae5f1be39763373f)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:02.335801 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:02.397288 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '970066df62394057ae5f1be39763373f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.406604 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '970066df62394057ae5f1be39763373f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.407358 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '970066df62394057ae5f1be39763373f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.418917 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '970066df62394057ae5f1be39763373f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.419839 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '970066df62394057ae5f1be39763373f'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.440789 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1453/2943] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:28:02 2022] DELETE /identity/v3/users/970066df62394057ae5f1be39763373f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:28:02.636090 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:02.649069 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9739f-883d-4cb3-a488-d2c0075d2cef service placement] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:02.714705 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:02.715354 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:02.715648 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:02.715941 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] PATH_INFO: `/v3/projects/3cf4deb459274fd296fcdb1078ebf678` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:02.717066 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf4deb459274fd296fcdb1078ebf678)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:02.719056 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:02.769791 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf4deb459274fd296fcdb1078ebf678', 'request_id': 'req-dafae167-547e-4399-aa8e-09616672eac6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.779297 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf4deb459274fd296fcdb1078ebf678', 'request_id': 'req-dafae167-547e-4399-aa8e-09616672eac6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.786472 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf4deb459274fd296fcdb1078ebf678', 'request_id': 'req-dafae167-547e-4399-aa8e-09616672eac6'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.799012 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] The token cache is being invalidate because project 3cf4deb459274fd296fcdb1078ebf678 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:28:02.799187 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.799883 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.801572 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1491/2944] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:28:02 2022] DELETE /identity/v3/projects/3cf4deb459274fd296fcdb1078ebf678 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 30 00:28:02.805699 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:02.807538 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:02.828597 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6515463a-1e76-4891-8bd7-9b6825f1500b admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:02.886184 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:02.886810 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:02.887087 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:02.887359 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] PATH_INFO: `/v3/users/0eaadedcb89b4febb9cb72c1e6658433` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:02.888499 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0eaadedcb89b4febb9cb72c1e6658433)` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:02.890446 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:02.896921 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:02.940526 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0eaadedcb89b4febb9cb72c1e6658433'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.948746 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0eaadedcb89b4febb9cb72c1e6658433'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.949513 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0eaadedcb89b4febb9cb72c1e6658433'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.958130 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0eaadedcb89b4febb9cb72c1e6658433'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.959138 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.notifications [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0eaadedcb89b4febb9cb72c1e6658433'} {{(pid=81661) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:02.976737 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1454/2945] 10.222.0.43 () {58 vars in 1224 bytes} [Tue Aug 30 00:28:02 2022] DELETE /identity/v3/users/0eaadedcb89b4febb9cb72c1e6658433 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:28:03.151836 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Authenticating user token {{(pid=81662) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:03.153295 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.fernet_utils [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81662) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:03.167728 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafae167-547e-4399-aa8e-09616672eac6 admin admin] Validating token access rules against request {{(pid=81662) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:03.231388 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87f9b76a136e4875a30812fb5a16d50e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5371435029143138d8fb9e32ebf3198', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81662) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:03.232023 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:03.232305 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] SCRIPT_NAME: `/identity` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:03.232610 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] PATH_INFO: `/v3/projects/257ad820b1744ff885727df9281522c6` {{(pid=81662) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:03.233804 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] RBAC: Authorizing `identity:delete_project(project_id=257ad820b1744ff885727df9281522c6)` {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:03.235733 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] RBAC: Authorization granted {{(pid=81662) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:03.243176 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:03.286559 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '257ad820b1744ff885727df9281522c6', 'request_id': 'req-f78081b8-5dde-4616-be22-26978d93166e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:03.294331 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '257ad820b1744ff885727df9281522c6', 'request_id': 'req-f78081b8-5dde-4616-be22-26978d93166e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:03.301484 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '257ad820b1744ff885727df9281522c6', 'request_id': 'req-f78081b8-5dde-4616-be22-26978d93166e'} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:03.312304 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] The token cache is being invalidate because project 257ad820b1744ff885727df9281522c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81662) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 30 00:28:03.312587 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:03.313230 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG keystone.notifications [None req-f78081b8-5dde-4616-be22-26978d93166e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81662) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 30 00:28:03.314755 dv-cinder-815746-8-smb devstack@keystone.service[81662]: [pid: 81662|app: 0|req: 1492/2946] 10.222.0.43 () {58 vars in 1233 bytes} [Tue Aug 30 00:28:03 2022] DELETE /identity/v3/projects/257ad820b1744ff885727df9281522c6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 30 00:28:12.972872 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:13.309198 dv-cinder-815746-8-smb devstack@keystone.service[81662]: DEBUG dbcounter [-] [81662] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81662) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 00:28:35.844431 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Authenticating user token {{(pid=81661) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 30 00:28:35.845867 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:35.915673 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873bab1-50cc-49aa-af19-7660dd92866a admin admin] Validating token access rules against request {{(pid=81661) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 30 00:28:35.976643 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b0af289f07d14247a60083dcc34197a1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '89e61c14cd024865b7fb0bef59d89c0a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81661) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 30 00:28:35.977262 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] REQUEST_METHOD: `GET` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 30 00:28:35.977552 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] SCRIPT_NAME: `/identity` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 30 00:28:35.977863 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81661) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 30 00:28:35.979641 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.fernet_utils [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81661) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 30 00:28:35.990912 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 30 00:28:35.992507 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16f21ce-182d-4752-a5a7-65526aef46c1 service placement] RBAC: Authorization granted {{(pid=81661) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 30 00:28:36.002316 dv-cinder-815746-8-smb devstack@keystone.service[81661]: [pid: 81661|app: 0|req: 1455/2947] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Aug 30 00:28:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 30 00:28:45.998181 dv-cinder-815746-8-smb devstack@keystone.service[81661]: DEBUG dbcounter [-] [81661] Writing DB stats keystone:SELECT=58 {{(pid=81661) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}